Security News

Cybersecurity news aggregator

📰
INFO News Reddit r/netsec

Active deception against AI pentesting agents: context saturation, tarpitting benchmarks, and cited research

Read Full Article →

In November 2025, Anthropic publicly disclosed the first documented AI-orchestrated cyber campaign, detected months earlier. A Chinese state-sponsored group used an autonomous AI agent to execute 80-90% of a multi-stage operation targeting tech companies, financial institutions, and government agencies, with human operators intervening at only a handful of decision points. At peak, the agent made thousands of requests, often multiple per second. That speed gap is the AI agent cybersecurity problem in a sentence. Human defenders can't match it. And most detection tools weren't designed for it either. The Agentic AI Cybersecurity Threat Is Operational, Not Theoretical The predictions have caught up with reality. Gartner expects 25% of enterprise breaches to trace back to AI agent abuse by 2028. CrowdStrike's 2026 Global Threat Report logged an 89% year-over-year increase in AI-enabled attacks. Cornell Tech researchers tested CrewAI on GPT-4o and achieved data exfiltration in 65% of scenarios (arXiv:2503.12188). The same study found Microsoft's Magentic-One orchestrator executes arbitrary malicious code 97% of the time when exposed to adversarial files. These aren't research demos. XBOW, an autonomous AI pentesting system, reached #1 on HackerOne's U.S. leaderboard in June 2025 after submitting over 1,000 vulnerability reports. It completed a benchmark that takes human pentesters 40 hours in 28 minutes. XBOW succeeds partly because it uses deterministic, algorithmic validation rather than pure LLM inference. Most threat actors don't have that engineering discipline. Palisade Research runs an LLM Agent Honeypot that has logged over 20 million access attempts since October 2024. As of early 2026, they've confirmed three autonomous AI agents (with 14 flagged as probable) probing from multiple countries including Hong Kong, Singapore, and Poland. Those confirmed agents weren't directed by a human operator. They found the honeypot and started enumerating it on their own. How These Agents Actually Process Your Network Understanding the vulnerability requires understanding the architecture. We reviewed the source code and papers behind PentestGPT (USENIX Security 2024), hackingBuddyGPT (TU Wien), AUTOATTACKER (UC Irvine/Microsoft), and several LangChain/CrewAI-based agents. They all share the same pipeline: Run a scanning tool (nmap, masscan, custom scripts) Feed the raw output into an LLM context window Let the LLM decide what to investigate next Repeat AI Agent Reconnaissance Loop 01 Scan 02 Ingest 03 Decide 04 Repeat Active deception poisons steps 2 and 3 Fabricated scan data overwhelms the agent's context and degrades every decision it makes The critical detail: the vast majority of these frameworks delegate target prioritization entirely to LLM inference. While enterprise-grade tools like XBOW use hybrid deterministic rules, the open-source agent frameworks that threat actors actually modify and deploy rely on the model to pick what looks interesting: PentestGPT maintains a task tree, but ordering within that tree is pure LLM judgment. hackingBuddyGPT's core agent is roughly 50 lines of code with a round-based loop that asks the model to "give your command." AUTOATTACKER adds a RAG-based experience manager but still delegates all targeting decisions to GPT-4. But even hybrid attackers face a structural problem. Every framework in this list assumes the data it scans is real. The LLM has no mechanism to verify whether a service response is authentic or fabricated. If the environment itself is hostile to reconnaissance, the pipeline has no fallback. None of these frameworks were built for a network that fights back. How Active Deception Breaks the Agent Architecture An active deception grid occupies unused IP space across your network. Firewall or router rules divert traffic destined for these ranges to the deception engine. A single sensor emulates thousands of hosts with polymorphic service signatures, each running protocol-accurate conversations. These aren't static banner strings. An agent scanning port 3389 triggers a full X.224 RDP negotiation. Port 445 returns a three-step NTLM handshake. Port 22 exchanges SSH KEXINIT. When an AI agent targets a subnet defended by this architecture, three structural failure modes compound simultaneously, resulting in a total pipeline collapse. 1. Context Saturation (Memory Exhaustion) A typical nmap service banner line runs about 20 tokens. A /16 deception grid with 65,536 emulated hosts, each running dozens of unique services, generates tens of millions of tokens of fake service data. GPT-4o's context window is 128,000 tokens. The raw data instantly exceeds it. The agent still tries to process everything, chunk by chunk, burning through API credits and hours of compute. But every chunking strategy heavily degrades the agent's memory: hackingBuddyGPT uses a sliding window that silently drops the oldest entries. LangChain's ConversationSummaryBufferMemory progressively compre...

Share this article