A Proofreader for Diffusion Language Models: DiVR Learns When to Throw Away a Draft and Start Over

External verifier predicts dead-end generations in diffusion LMs, boosting accuracy from 35.3% to 43.4% at half the compute cost of brute-force search.

You know that moment when you're writing an email, realize the second paragraph painted you into a corner, and instead of fixing it word-by-word you just select-all and start fresh? That's the core mechanism here. Diffusion language models generate text by iteratively "unmasking" tokens, and they can remask (re-cover) tokens to try again — but the authors show this local erasing almost never works when the surrounding context is already broken. The fix: an external judge that decides when to scrap a whole block and regenerate from scratch. The committed claim is that an auxiliary verifier trained on trajectory-level correctness signals — not token-level confidence — can reliably detect doomed generations early enough to save compute. The paper calls this DiVR (Diffusion Verifier for Regeneration). It monitors partially generated sequences and predicts whether the current trajectory will reach a correct final answer. When it detects failure, it triggers block-level regeneration rather than token-level remasking. The generator itself is never modified. Two diagnostic findings anchor the design. First, on a controlled Sudoku testbed, the authors show that hidden states inside the diffusion model already encode error information that surface-level token confidence scores miss. Second, remasking a single erroneous token while leaving its neighbors fixed almost always reproduces the same error — the context has already committed to the wrong path. These are clean, falsifiable observations, and they directly motivate the block-regeneration strategy. On the ladder: DiVR applied to LLaDA-8B-Base pushes average accuracy across five reasoning benchmarks from 35.3% to 43.4%. The key efficiency comparison is that DiVR achieves this at 1.9–3.5× the cost of greedy decoding, while search-based baselines that achieve comparable or lower accuracy cost 3.8–7.4×. The paper also shows DiVR stacks with supervised fine-tuning and reinforcement learning, and transfers to a different generator architecture (Dream), which is a meaningful generalization test. The architecture is straightforward: DiVR is a classifier head trained on binary correctness labels harvested from the generator's own rollouts. It sits in the family of outcome-based reward models / verifiers that have become standard in autoregressive LLM pipelines (think ORM or PRM from the math-reasoning literature), but adapted to the discrete-diffusion generation loop. The compute property it leans on is cheap: you only need the generator's existing hidden states and a lightweight classifier, not a second full-size model. Integrity is mixed. The five reasoning benchmarks are standard (GSM8K, MATH, etc.), and the Sudoku diagnostic is well-controlled. But the validation is entirely same-team: the authors train DiVR, evaluate DiVR, and report DiVR. No independent replication exists. The paper is honest about when DiVR fails to help, and ablations are present, but benchmark selection could have been post-hoc — no pre-registration is mentioned. Code availability is not explicitly stated in the abstract. The obvious successor experiment: scaling DiVR to larger diffusion language models (the current testbed is 8B parameters) and testing on open-ended generation tasks beyond reasoning benchmarks. My honest read is (a) — they likely ran out of compute. Training a verifier requires many generator rollouts, and doing that at 70B scale is expensive. The paper also does not test whether DiVR's learned signal transfers across problem domains without retraining, which would be the real test of whether it has learned something structural about diffusion-model failure modes rather than task-specific heuristics.