VLMs Can't Count Past Five — So GeoScope Stops Asking Them To

Training-free framework measures VLM counting limits like a sensor spec sheet, then splits satellite images accordingly. Beats all trained methods on ultra-high-res remote sensing QA.

You know how a bathroom scale is accurate up to about 300 pounds, and past that it just reads '300'? Every vision-language model has the same kind of ceiling for counting objects in an image — and nobody was measuring it. GeoScope treats VLMs the way an engineer treats an instrument: find the operating range, stay inside it, and compensate when the signal degrades. The committed claim is crisp. All eight open VLMs tested systematically undercount once a single view contains more than roughly five objects, tested on DOTA aerial imagery. This 'counting horizon' gets worse as the view gets larger and objects get smaller. The authors fit a power-law response model that predicts how much a given split will recover in true counts and how many spurious detections it will add. This is the first UHR remote sensing method to use a measured VLM limit to decide when and how to split views. The system architecture is elegant in its simplicity. A text-only LLM parses a natural-language question into a typed spatial program — fixing the target region and its resolution. The VLM only grounds and counts within its calibrated operating range. Directional spatial relations (north of, east of) are computed explicitly from bounding boxes, not hallucinated by the VLM. No training is required. The whole pipeline is a program executor, not a fine-tuned model. The numbers are strong and broad. On XLRS-Bench, GeoScope improves Qwen3-VL-8B by 16.3 points on regional counting and 10.5 on spatial relations — and achieves the highest reported accuracy on regional counting and on the full benchmark by question count, beating trained methods. On UHR-Micro, global and regional counting improve by 16.8 and 36.2 points respectively, with 15.6 of the global gain attributable to splitting alone. On MME-RealWorld counting, it gains 11.4 points. Notably, the authors identify a distortion in MME-RealWorld where an option that is almost never correct is disproportionately chosen by models, warping comparisons there. The integrity picture is mixed but honest. The benchmarks are community-standard (XLRS-Bench, UHR-Micro, MME-RealWorld), and the authors test eight different VLMs to show the counting horizon is model-general, not cherry-picked to one architecture. The power-law calibration model is empirically derived from DOTA, and they acknowledge this. But there's no independent replication, no pre-registration, and the calibration-on-DOTA-then-test-on-other-benchmarks loop deserves scrutiny — if the power-law parameters are even slightly benchmark-coupled, the gains could be inflated. The 72-page paper with supplementary material suggests thorough ablations. The milestone question is where this gets interesting. The counting horizon of ~5 is a VLM limitation, not a GeoScope limitation. If next-generation VLMs push that horizon to 15-20 objects, splitting becomes less necessary and the engineering overhead of GeoScope shrinks. Conversely, if the horizon stays stuck at 5, this calibrate-and-split paradigm becomes essential infrastructure for any real deployment in remote sensing, agriculture monitoring, or urban planning. The key number to track is the counting horizon of frontier VLMs over the next 2-3 years. The experiment they didn't run: closed-source VLMs. GPT-4o, Gemini 2.5, Claude Sonnet — these likely have different counting horizons, and knowing whether the power-law model transfers to proprietary systems would dramatically change the adoption story. The honest read is (a) API cost for the number of evaluations needed, combined with (c) strategic positioning of an open-model pipeline. A secondary gap: real-world deployment latency. Splitting images means more VLM forward passes; the paper doesn't report wall-clock times at scale.