Imagine you're managing a kitchen during dinner rush. You don't cook every dish — you watch the line cooks. Most of the time you're scanning (cheap, fast), but when you spot a cook reaching for cumin instead of coriander, you step in with a specific correction (expensive, slow). The skill isn't cooking — it's knowing when to intervene and what to say. That's the exact architecture this paper builds for LLM agent systems. The committed claim: a dedicated steering agent, trained end-to-end with reinforcement learning, can supervise both single-agent and multi-agent LLM systems during execution, detect goal drift in real time, and generate corrective interventions — and this learned steering intelligence transfers to unseen tasks and executors without retraining. The paper frames goal drift as the central failure mode of long-horizon agentic systems, arguing that static prompting and planning are insufficient because execution context evolves unpredictably. The architecture is a dual-path system. The fast path is a lightweight classifier that observes the execution trace and decides whether to intervene — a binary gate with low compute cost. The slow path is a generative model that produces the actual corrective instruction when the fast path fires. Both paths are jointly trained using GRPO (group-relative policy optimization), with a pairwise ranking objective that teaches the fast path to distinguish drifting from on-track states. This fast/slow split is the paper's structural contribution — it separates the 'when' from the 'how' of supervision and trains them in a coupled loop rather than as independent modules. Experiments center on information-seeking search tasks, where agents must navigate multi-step tool use to find answers. The steering agent improves both performance (task success) and efficiency (fewer wasted steps) across single-agent and multi-agent configurations. The generalization results are the strongest signal: the steering agent transfers to out-of-domain tasks and unseen executor models, suggesting it learns something about drift detection that isn't task-specific or executor-specific. The integrity picture is mixed. The evaluation is on the authors' own benchmark tasks — there's no pre-registered test set or community-standard agentic benchmark like SWE-bench or WebArena mentioned in the abstract. The generalization claims are promising but demonstrated within the information-seeking domain family; the distance to truly out-of-domain (e.g., code generation, embodied agents) is unclear from the abstract alone. The controllable intervention frequency without retraining is a nice engineering property but needs stress-testing at scale. The ladder position is interesting but hard to pin precisely from the abstract. The natural baselines are: (a) no supervision, (b) rule-based intervention triggers, (c) prompted LLM-as-judge supervision without RL training. The paper needs to beat all three convincingly, especially (c), since a strong prompted supervisor is the obvious cheap alternative. The RL training overhead only justifies itself if it produces meaningfully better drift detection than prompting alone. The successor question is clear: scaling to harder, longer-horizon tasks (multi-day code projects, research agents, embodied robotics) and testing against the strongest prompted-supervisor baselines with frontier models. The authors likely didn't run these because compute costs for RL training on longer horizons scale badly, and frontier model API costs for the executor make large-scale ablations expensive. Expect the next paper to target SWE-bench or a similar community benchmark.
