Imagine you're learning to cook from a chef who can taste the dish while you can only see it. The chef keeps saying "add more salt" — but sometimes that advice comes from actually tasting the broth, and sometimes it's just habit. If you follow every correction blindly, you learn the chef's tics alongside their skill. This paper builds a filter that checks: did the chef's correction actually come from tasting, or from autopilot? The committed claim: on-policy self-distillation (OPSD) — where a privileged teacher model corrects a student's token-level outputs during reinforcement learning — suffers from what the authors call "privileged-correction contamination." Some teacher corrections reflect genuine visual evidence; others reflect linguistic priors, response style, or artifacts of the teacher's privileged view. Mixing them poisons the learning signal. The paper proposes Visual-Attribution Gating (VAG), which filters corrections by contrasting what the teacher says when visual evidence is present versus when it's degraded. Only corrections whose direction survives this contrast get through. The mechanism is elegant in its simplicity. VAG uses the verifier-derived advantage from RLVR (reinforcement learning with verifiable rewards) as an optimization anchor — this is the task-level "did you get the right answer" signal. For each token-level correction from the teacher, VAG checks whether the correction's direction is consistent between the evidence-present and evidence-degraded teacher views. If degrading the visual evidence doesn't change the teacher's correction, that correction was never about the image in the first place — it gets suppressed. This is a causal-contrast test applied at the token level, not a new architecture. The ladder position is solid but bounded. The authors benchmark across six visual reasoning tasks and report that VAG consistently outperforms both GRPO (the RL baseline) and standard OPSD methods, claiming new state-of-the-art average performance. The key qualifier: the abstract says "average performance" across six benchmarks, not dominant performance on every single one. Without the actual numbers from the full paper, the margin of improvement and per-benchmark variance remain to be verified. The baselines — GRPO and OPSD — are current and relevant, not stale. Architecturally, this sits in the intersection of two active research programs: RLVR for multimodal models (the GRPO family) and knowledge distillation with privileged information. The method is gradient-based, operates on-policy, and adds a gating mechanism on top of the standard policy-gradient + distillation loss. The compute overhead of VAG comes from running the teacher twice per correction — once with full evidence, once with degraded evidence — to produce the contrast signal. This is a 2× teacher-inference cost for the filtering step, which is nontrivial at scale. The integrity picture is mixed. Six benchmarks is a reasonable spread, and comparing against both GRPO and OPSD is honest baseline selection. However, the validation is entirely same-team simulation — no independent replication, no pre-registration, and the abstract doesn't mention code release. The choice to report "average performance" rather than leading with per-benchmark results is a soft flag; averaging can mask cases where the method underperforms. The formalization of "privileged-correction contamination" is useful but also conveniently scoped to make VAG the natural solution. The milestone question for this line of work is whether gated distillation methods can scale to larger models and harder reasoning tasks — say, from current 7B-class VLMs to 70B+, and from visual math/chart QA to open-ended visual reasoning where verifiable rewards are harder to define. The gap between "works on six benchmarks" and "changes how people train production multimodal models" is still significant. The obvious next experiment the authors didn't run: ablating the degradation strategy. How you degrade visual evidence (masking, blurring, replacing with noise) almost certainly affects which corrections pass the gate, and the sensitivity of VAG to this design choice would reveal how robust the method actually is. My read: they probably tried a few variants and picked the one that worked best, which is standard practice but worth flagging.
