Imagine you're a building inspector. You could stand outside the house, look at the front, and declare it finished. Or you could walk inside, open the faucets, flip the switches, check the attic. The first approach is what most current CUA verifiers do—they look at a trajectory of screenshots and guess. VeriCUA is the inspector who actually walks through the house. The committed claim: verification of computer-using agent task completion should be reframed from static judgment (look at the evidence you're given) to dynamic evidence gathering (go find the evidence you need). VeriCUA constructs a task rubric from the available context, then actively selects GUI checks (screenshot inspection) or code checks (programmatic state queries) for each unresolved requirement, combining findings under explicit evidence rules. The key move is treating the verifier itself as an agent that explores. This sits in the growing ecosystem around CUA evaluation—agents that operate desktop, mobile, and web environments. The current standard approaches fall into two camps: VLM judges that prompt a vision-language model to score a trajectory, and programmatic verifiers that generate code to inspect application state. Both are limited by their observation window. The VLM only sees what you show it. The program only queries what's accessible through the API. VeriCUA's contribution is unifying these into a single agentic loop that adaptively chooses which modality to deploy for each verification sub-question. Architecturally, this is a VLM-based agentic framework—the verifier is itself a prompted vision-language model that operates in a loop: inspect context, build rubric, choose check type (GUI or code), execute check, assess evidence, repeat for unresolved items. The platform-agnostic design means the same procedure works across desktop, mobile, and web without platform-specific engineering. This is closer to an agent harness pattern than a novel model architecture—the intelligence comes from the orchestration, not a new neural network. The integrity picture is incomplete by the authors' own admission—this is explicitly labeled 'work in progress.' The paper reports improved agreement with reference labels over baselines across online and offline settings, with the largest offline gains on hard cases and stronger rejection of false completion claims online. But we don't have named baseline numbers, specific accuracy figures, or benchmark names from the abstract alone. The claim about 'complementary evidence' and 'test-time exploration' driving gains is plausible but unquantified in the available text. The milestone question for CUA verification is concrete: what false-positive and false-negative rates make verification reliable enough to use as a reward signal for RL training? If your verifier has a 20% error rate, your RL signal is poisoned. The field needs verification accuracy above ~95% on hard cases before CUA training loops become self-improving rather than self-corrupting. VeriCUA's largest gains being on hard cases is the right signal—that's exactly where false positives are most dangerous. The obvious next experiment not reported: ablation showing how much of the gain comes from the agentic exploration loop versus simply having access to both GUI and code checks. If most of the gain is just 'use both modalities,' the agentic framing is window dressing. If the iterative exploration genuinely discovers evidence that a single-pass dual-modality check misses, that's the real contribution. My read: the authors likely have this ablation in progress and are saving it for the full version—the 'work in progress' label suggests this is a positioning paper, not the final story.
