Imagine you're a hospital administrator who has hired six specialist doctors, each brilliant at diagnosing one disease but prone to false alarms on everything else. A patient walks in with ambiguous symptoms. Three specialists say cancer, two say infection, one says healthy. You don't need a seventh specialist — you need a triage nurse who knows which doctors to listen to for which symptoms, and a chief of medicine smart enough to weigh conflicting opinions. That's exactly the problem this paper dissects for image forensics. The committed claim: in open-world fake image detection, the dominant factor driving performance is not the quality or number of specialist forensic detectors — it's the reasoning quality of the LLM judge that arbitrates their conflicting outputs. Manipulation recall is already near saturation across all tested configurations. What kills real-world performance is false positives on authentic images, caused by naive fusion of detector outputs without triage or trust calibration. The authors build a training-free agentic framework that wraps existing specialist detectors (covering fully synthetic images, localized edits, splicing, face swapping) with three mechanisms: per-detector triage that filters unreliable evidence, structured prompting that exposes detector limitations to the LLM, and conflict-aware evidence arbitration. They test six configurations across three multimodal LLM backbones (the specific models are not named in the abstract but evaluated in the 34-page paper) on both in-distribution and out-of-distribution data. No fine-tuning, no retraining — this is a pure orchestration study. The ladder result is clear and useful. Naive detector fusion — just averaging or majority-voting across specialist outputs — produces severe false-positive rates on authentic images. Adding triage and structured prompting consistently improves performance by filtering out-of-scope evidence. But the biggest lever is swapping the LLM backbone itself: a stronger judge substantially outperforms a weaker one, particularly under distribution shift. This tells you the ceiling isn't in the detectors — it's in the reasoning layer. The architecture choice matters: this is explicitly non-trained, prompt-based orchestration. No gradient updates, no learned fusion weights. The method leans entirely on the in-context reasoning and instruction-following capacity of multimodal LLMs. This makes it cheap to deploy and easy to swap components, but it also means performance scales with LLM capability rather than with forensic-specific training data. That's a bet on general reasoning over domain specialization. The integrity profile is mixed. Six configurations and three LLM backbones give decent coverage, and both in-distribution and out-of-distribution evaluation is a genuine strength — most forensics papers skip the OOD test. But this is the authors' own framework evaluated by the authors, on benchmarks they chose. No pre-registration, no indication of released code in the abstract. The 34-page length (17 main + 17 appendix) suggests thorough documentation, but independent replication is absent. The sharpest takeaway for practitioners: if you're building a forensic pipeline, stop optimizing individual detectors and start investing in the arbitration layer. The paper essentially argues that open-world forensics has shifted from a detection problem to a calibration-and-reasoning problem — and that's a fundamentally different engineering challenge with different scaling properties.
