Imagine you hired a brilliant intern to deliver packages by bicycle. They navigate perfectly — dodging traffic, reading maps, finding every address. But when they arrive, they either ring the doorbell before reaching the porch or pedal past the house entirely, never stopping. The delivery fails not because of the riding, but because of the last three seconds of judgment. That's the core finding of DroneCATS. The committed claim: when you drop a multimodal LLM into a drone's control loop with zero fine-tuning — declaring the entire action space in the prompt alone — spatial perception holds up but action protocol falls apart. The paper introduces DroneCATS-Agent, a modular architecture where the MLLM is a swappable black box, and DroneCATS, a benchmark suite testing four capabilities: approaching a visible target, tracking a moving one, searching outside the initial field of view, and commanding a multi-drone fleet. The MLLM makes every decision — yaw, search, deliberate, and critically, self-declare arrival. The paradox is striking. Small open models (down to 2B parameters) often navigate into the success radius more reliably than frontier models. But they lose episodes by declaring arrival prematurely or failing to declare it at all. The flying works; the stopping doesn't. Multi-drone commanding makes this worse: small models degenerate into copying a single coordinate across distinct camera views, treating plural agents as one. Architecturally, this is a prompt-only, zero-shot VLA (vision-language-action) pipeline. No fine-tuning, no function-calling schemas, no reward shaping. The MLLM receives image frames and a text prompt declaring available actions, then emits structured action tokens. The benchmark treats the model as the sole independent variable — same simulator, same scenarios, different model weights. This is a clean experimental design for isolating model capability from system engineering. The ladder position is honest but limited. The paper evaluates frontier models (GPT-4o-class) and open models across the four tasks, but the baselines are other MLLMs, not classical drone-control pipelines. There's no comparison against, say, a traditional detect-track-control stack with PID controllers — which would likely crush all MLLMs on approach and tracking tasks. The contribution is measuring where LLM-as-agent fails within its own paradigm, not proving it beats conventional control. Integrity has real strengths and real gaps. The benchmark is custom-built (AirSim-based simulation), not a community standard, and the evaluation metrics are author-defined. No code or benchmark release is mentioned in the abstract. The experimental design — model as independent variable, consistent environment — is methodologically sound, but the lack of pre-registration and external benchmarks means we're watching the authors grade their own exam. The finding itself (protocol discipline > spatial perception) is the kind of negative result that's hard to cherry-pick, which adds credibility. The milestone that matters isn't qubit-style — it's a behavioral threshold. Today, small models navigate into success radii but fail 'last-meter' protocol execution. The unlock is a 2-7B model that sustains a declared action protocol end-to-end at inference costs compatible with onboard edge compute (think Jetson-class hardware). The paper frames this as the open problem. The successor experiment nobody ran: fine-tuning a small model specifically on arrival-declaration episodes, or adding a lightweight protocol-compliance head on top of the frozen MLLM. The honest read is (a) — they scoped this as a zero-shot evaluation paper and fine-tuning is the obvious next paper, likely already underway given the team size (14 authors across what appears to be a corporate lab).
