
Read the paper
ViRA: Toward Ultra-High-Resolution Visual Agents via Cross-Input Relative Policy Optimization
on GitHub
Imagine you're a teacher grading multiple-choice tests, and you suspect some students are just pattern-matching — picking 'Paris' whenever the question mentions 'capital of' without reading the passage. You can't tell from a single test. But if you give them five versions of the same question where the passage is tweaked so the answer changes each time, the guesser fails the set while the reader aces it. That's CrossRPO in a sentence: grade the whole contrast set, not individual answers. The committed claim is that standard reinforcement learning on visual question-answering is broken for ultra-high-resolution images because a correct guess from common sense earns the same reward as actually reading the evidence in the image. CrossRPO fixes this by training on contrast sets — groups of images identical except for one small edited region that changes the answer. The method rewards solving the entire set, and the authors provide a formal proof that this objective cannot reinforce common-sense guessing. The ladder here is sharp and honestly reported. On ViRA-Bench at maximum resolution, CrossRPO achieves 63.3% set accuracy versus 59.3% for GRPO — a 4-point gap that matters because set accuracy is specifically designed to be unforgivable of guessing. ViRA-9B becomes the most accurate open model at its size class across all benchmarks tested, and ViRA-27B outperforms Claude Haiku 5.5 and GPT-6-Luna at their highest thinking levels on most benchmarks. These are not cherry-picked toy comparisons. Architecturally, this sits in the RLHF/RLAIF family of post-training alignment methods, specifically extending Group Relative Policy Optimization (GRPO) into what they call cross-input relative policy optimization. The key structural innovation is that the 'group' in group-relative now spans multiple inputs rather than multiple rollouts of the same input. The agents themselves are built on standard vision-language model backbones (9B and 27B parameters) with a zoom-in action space for navigating ultra-high-resolution images from 21 to 120 megapixels. Integrity is notably strong for this subfield. The authors built both a training set (ViRA-Train, ~3,500 items) and a held-out evaluation benchmark (ViRA-Bench) using image editing, then went further by photographing real-world contrast sets (ViRA-Bench-Real) with actual physical changes to exclude the possibility that models detect editing artifacts rather than read content. The formal proof that CrossRPO cannot reinforce common-sense answers is a meaningful addition — it's not just empirical, there's a mathematical guarantee under their assumptions. Code is released. The training efficiency is striking: only about 3,500 contrast-set items per model. This isn't a compute-bludgeon paper. The method is lightweight enough to be practical, which matters for adoption. The 74-page paper with 26 tables suggests thorough ablation, not padding. The obvious experiment not run: scaling CrossRPO to larger backbone models (70B+) and testing whether the contrast-set advantage holds or diminishes as base model capability increases. The honest read is probably (a) compute budget — training 70B+ models with RL is expensive — combined with (c) saving it for a follow-up. If common-sense reliance is a deeper architectural problem, CrossRPO's advantage should grow with scale; if it's a small-model crutch, the gap would shrink. That experiment is the real test.
The analogy
You're a teacher who suspects students are guessing 'Paris' on every geography test without reading the passage. You can't catch them with one test. But give them five versions where the passage is edited so the answer changes each time — the guesser fails the set, the reader aces it. CrossRPO grades the whole set, not individual answers.
Cheat-proof exam
Five versions of the same question with different correct answers — only the student who reads the passage aces all five
CrossRPO training
Contrast sets of images identical except for one small region — only the agent that reads the evidence solves the whole set
Honest assessment
This is a well-executed paper that identifies a real and under-addressed failure mode — vision models gaming VQA by guessing from language priors — and provides both a principled fix (contrast sets + formal proof) and strong empirical results against current commercial models. The ~3,500 training items make it practical, not just theoretical. The open question is whether CrossRPO's advantage persists at 70B+ scale or whether larger models self-correct. Worth reading if you build or evaluate vision-language systems.
What Is CLAIMS?
77
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
4/5
Architecture
4/5
Integrity
4/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Real innovation, not just an increment. The cross-input grouping in RL is a genuine structural novelty with a formal guarantee. Not first-of-kind in VQA or RL, but first to provably block common-sense reward hacking.
The field fight
Can post-training RL actually teach vision-language models to ground answers in visual evidence, or does it just reinforce linguistic priors?
Side A
Standard RL (GRPO, PPO, DPO) is sufficient — scale and data quality solve grounding
Held by: DeepSeek-R1, standard RLHF pipelines
Side B
Standard RL rewards are fundamentally blind to guessing vs reading — structural changes to the reward are needed
Held by: This paper (CrossRPO), contrast-set evaluation tradition
Milestone tracker
Unlocks: Trustworthy visual agents for real-world inspection: satellite imagery, medical scans, industrial QA at ultra-high resolution
Current
63.3
% set acc
CrossRPO on ViRA-Bench
Next
80
% set acc
Reliable evidence reading
~1-2 years with backbone scaling and better contrast sets
Verified Facts (6)
CrossRPO achieves 63.3% set accuracy on ViRA-Bench at the maximum resolution, against 59.3% for GRPO
ViRA-9B is the most accurate open model of its size on all benchmarks
ViRA-27B outperforms Claude Haiku 5.5 and GPT-6-Luna, both at their highest thinking level, on most benchmarks
Images range from 21 to 120 megapixels
Training used approximately 3,500 items of ViRA-Train per model
74 pages, 11 figures, 26 tables
Practical Implications (3)
Teams building visual QA agents for high-resolution domains (satellite, medical, industrial) can adopt CrossRPO with minimal data (~3,500 contrast-set items) to significantly reduce common-sense hallucination
Contrast-set construction is a reusable evaluation methodology — any VQA benchmark can be hardened against guessing by creating contrast variants
ViRA-Bench and ViRA-Bench-Real provide ready-made evaluation tools for ultra-high-res visual grounding that existing benchmarks do not cover
More latest news
Read all