Read the paper
AutoPI: Taxonomy-Guided Adaptive Red Teaming for Prompt Injection in LLM Agents
on Project Page
MORE THAN
+90%
ACHIEVES BETWEEN
+20%
BETWEEN
+50%
ASR BETWEEN
+25%
Imagine you're a locksmith hired to test the security of an office building. You could pick the front door fifty times and report a 100% break-in rate. Or you could try every door, window, vent, and skylight once each — and hand the building owner a map of which entry points are weak. Most adaptive red teamers for LLM prompt injection are front-door pickers. AutoPI is the full-building audit. The committed claim: AutoPI is the first adaptive red teamer that optimizes for technique coverage — the fraction of a prompt-injection taxonomy actually exercised — rather than raw attack success rate (ASR). It uses PIAtlas, a hierarchical taxonomy of prompt-injection techniques organized into classes, techniques, and sub-techniques, to systematically generate one injection per sub-technique, then iteratively reworks failures using LLM-judge feedback. No training, no gradient access, pure black-box. The ladder is convincing. On AgentDojo, AutoPI finds successful injections against Qwen3.6-35B across all six PIAtlas classes and over 90% of techniques. Against Claude Haiku 5.5 — the hardest target — it achieves 20-50% higher ASR and 25-400% higher class-level coverage compared to recent SOTA adaptive red teamers. Those are real deltas against named contemporaries, not stale baselines. The comparison targets include the strongest models the community cares about right now. Architecturally, this is a generate-then-refine loop: an attacker LLM produces candidate injections for each taxonomy node, an LLM judge scores them, and failures are reworked. It's training-free and black-box — meaning you don't need model weights or gradients, just API access. The taxonomy is the structural load-bearing element. If PIAtlas is incomplete or misclassified, AutoPI's coverage metric is measuring the wrong thing. The method's strength (modularity, plug-and-play with existing benchmarks) is also its dependency: the taxonomy must evolve faster than attacker techniques do in the wild. Integrity is decent but not bulletproof. Evaluation runs on two community benchmarks (AgentDojo, IPI Arena) across both open-weight and proprietary models — that's good diversity. Code and generated attacks are released. But the LLM judge introduces circularity: an LLM decides whether the attack succeeded against another LLM. The authors acknowledge this, but the degree to which judge-model agreement tracks human judgment isn't deeply validated. No pre-registration, and the benchmark selection may favor taxonomy-guided methods by design. The milestone question is about taxonomy completeness and real-world transfer. Right now AutoPI covers six PIAtlas classes; the next meaningful number is whether coverage holds when the taxonomy doubles in size as new injection families are discovered. And the real unlock is transfer to production agent systems — not benchmarks but deployed tool-using agents with real stakes. That's probably 1-2 years out if adoption follows. The obvious successor experiment is testing AutoPI against agents with real defenses deployed in production — system-prompt hardening, input sanitizers, output classifiers. The authors evaluate against bare models on benchmarks, which is the standard move, but the whole point of a coverage-aware red teamer is to surface blind spots in layered defenses. My read: they're saving it for the next paper, or the engineering overhead of building realistic defense stacks was outside scope.
The analogy
Think of a locksmith hired to test a building's security. Picking the front door fifty times gives you a 100% break-in rate but tells you nothing about the windows, vents, and skylights. AutoPI is the locksmith who tests every entry point once, then goes back to rework the ones that held — handing the owner a map of all weaknesses, not just the easiest one.
Building audit
Test every door, window, vent — not just the front door fifty times — to map all entry points
AutoPI red team
Generate one injection per taxonomy sub-technique, rework failures, to map all prompt-injection vulnerabilities
Honest assessment
AutoPI is a well-executed methodological contribution that reframes the red-teaming optimization target from frequency to diversity. The coverage gains over SOTA are substantial and the evaluation is honest. What's missing is validation against production defenses and deeper human-agreement checks on the LLM judge. This matters most for teams building LLM agent security pipelines right now — it's a tool paper, not a capability breakthrough, and that's fine.
What Is CLAIMS?
67
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
4/5
Architecture
3/5
Integrity
3/5
Milestone
2/5
Successor
4/5
What is this paper actually committing to?
Genuine reframing, not a new attack. Shifting optimization from ASR to taxonomy coverage is a real conceptual contribution, but it's methodological — not a capability breakthrough.
The field fight
Should red teaming for LLM agents optimize for attack success rate or attack diversity (technique coverage)?
Side A
Maximize ASR — breaking the model as often as possible is the best signal for hardening
Held by: Most existing adaptive red teamers, benchmark leaderboards
Side B
Maximize coverage — finding many different ways to break the model maps the full attack surface
Held by: AutoPI, this paper
Milestone tracker
Unlocks: Coverage-aware hardening of deployed tool-using LLM agents, not just benchmark models
Current
6
taxonomy classes
full class coverage (Qwen3.6-35B)
Next
12+
taxonomy classes
expanded PIAtlas with new injection families
~1-2 years as taxonomy evolves and production agent defenses mature
Verified Facts (6)
AutoPI finds a successful injection against Qwen3.6-35B in all six classes of the taxonomy and for more than 90% of its techniques
Against Claude Haiku 5.5, it achieves between 20% and 50% higher ASR and between 25% and 400% higher class-level coverage than recent state-of-the-art adaptive red teamers
The method is black-box and training-free
18 pages, 8 figures, 5 tables
Code released at https://github.com/stevendamianakis/autopi
Evaluated on AgentDojo and IPI Arena against open-weight and proprietary target models
Practical Implications (4)
Security teams evaluating LLM agents can drop AutoPI into existing benchmark pipelines as a plug-in replacement for fixed attack templates, getting broader technique coverage without training overhead
Taxonomy-guided coverage metrics should supplement ASR in red-team evaluations — high ASR can mask narrow attack diversity
Defense builders should test against taxonomy-complete attack suites, not just high-ASR attacks, to avoid hardening against one injection family while leaving others exposed
The PIAtlas taxonomy itself becomes a living dependency — teams adopting AutoPI need to track taxonomy updates as new injection families are discovered
More latest news
Read all