You know how a multiple-choice test with no correct answer reveals the difference between a student who genuinely knows the material and one who's just good at test-taking? The good-at-tests student always picks something — they never leave it blank. Generative LLMs are that student. This paper builds the version that raises its hand and says 'none of the above.' The core claim: System One decision models — which sit on top of LLMs but output calibrated probabilities over a fixed option set instead of generating free text — can learn to abstain when no correct legal holding exists. The authors extend the CaseHOLD benchmark (a multiple-choice legal reasoning task) by replacing the correct holding in 1,670 of 5,314 items, creating a 'missing authority' condition. Generative LLMs, from GPT-4o to Llama and Qwen variants, still commit to an answer 38–86% of the time when every option is wrong. The best decision model commits only 30% of the time — still imperfect, but a structurally different failure rate. On standard CaseHOLD where a correct answer exists, the best decision model matches the best generative LLM: 88.1% vs 88.2%. The cost differential is staggering — 1/55th the inference cost. This isn't a quality tradeoff; it's near-identical accuracy with an order-of-magnitude cost reduction and dramatically better behavior on the edge case that matters most in legal practice: the case where no authority supports the claim. The architecture is straightforward but the framing is sharp. System One models treat legal verification as classification over a closed option set, not open-ended generation. By returning a probability distribution, they give downstream systems a natural abstention threshold — if no option's probability exceeds a calibrated cutoff, the system declines. The paper further shows that using a decision model as a 'gatekeeper' for a generative LLM — accepting the LLM's answer only when the decision model agrees — cuts wrong citations roughly in half. A distillation experiment pushes the decision model's calibrated probabilities into Qwen3-8B without any labels, producing a local model that retains calibration. The integrity picture is solid for a workshop-scale paper. CaseHOLD is a community benchmark, the modified abstention variant is released with code and model outputs, and the comparison set includes six named generative models (GPT-4o, GPT-4.1, Gemini 2.5 Flash, Llama-3.1-70B, Qwen3-8B, Qwen3-32B) plus four decision model configurations. The main limitation the authors acknowledge: the abstention condition is synthetic — holdings are replaced, not discovered in the wild. Real missing-authority scenarios are messier. The paper's real contribution is reframing the evaluation metric for legal AI. Accuracy on items that have a correct answer is table stakes. The metric that matters in practice is the wrong-citation rate: how often does the system confidently assert authority that doesn't exist? Legal malpractice doesn't come from missing the right case — it comes from citing the wrong one. By making this the headline metric, the paper shifts the goalposts in a useful direction. What's missing is scale and ecological validity. CaseHOLD is a curated benchmark with five options per item. Real legal research involves open retrieval over millions of cases. Whether the abstention behavior transfers to retrieval-augmented settings, or whether the calibration holds when the option set is dynamically generated, is unaddressed. The distillation result is intriguing but preliminary — a single experiment on one model size with no downstream task evaluation.
