
Imagine you're a student who keeps getting marked down for wrong answers on a test. You figure out you can raise your accuracy by simply answering fewer questions — your error rate drops, but you're no longer demonstrating what you actually know. That's exactly what this paper catches preference-optimized vision-language models doing. Hansang Lee examines four publicly available preference-optimization (PO) checkpoints of LLaVA-1.5-7B and finds a consistent, overlooked pattern: these models reduce object hallucination primarily by naming fewer object categories, not by getting better at identifying what's actually in an image. The hallucination rate falls, but set-level object F1 on the CHAIR benchmark shows no significant gain — the models are just saying less. This is a diagnostic result, not a methods paper, and that distinction matters. The core experiment is elegant. By adding a positive logit bias to the end-of-sequence (EOS) token in the unmodified base model — literally telling it to stop talking sooner — Lee reproduces 58 to 86 percent of the CHAIRi improvement of three PO checkpoints across two disjoint COCO evaluation sets. The PO models' apparent hallucination reduction is, in large part, an artifact of brevity. When you force PO models to write longer with a negative EOS bias, they recover only 2 to 9 percent of their lost recall, and 94 to 96 percent of the additional object mentions just repeat categories already named. The models have genuinely lost coverage, not merely compressed it. The practical intervention is base-guided object-category restoration. Take the PO model's caption, run the same image through the unmodified base model, identify high-confidence object categories the PO model missed, and append them. No training, no gradient updates. With thresholds fixed on a development set, this brings three PO checkpoints within one point of base-model recall on a held-out COCO set while maintaining a lower distinct-object hallucination rate than the base model. It's a Pareto improvement: more objects named, fewer hallucinated. The integrity story is mixed. All evaluation uses CHAIR on COCO — a well-established community benchmark, but a narrow one. The paper tests on two disjoint COCO subsets with thresholds fixed on a separate development set, which is methodologically careful. But there's no evaluation on out-of-distribution images, no human evaluation, and no testing beyond LLaVA-1.5-7B. The finding is clean within its scope but that scope is deliberately limited. The paper's real contribution is reframing the evaluation conversation around preference optimization. If the field's standard metric (CHAIRi) rewards brevity without penalizing coverage loss, then PO leaderboard gains may be systematically overstated. Lee doesn't claim PO is useless — the residual 14-42% of CHAIRi gain beyond early stopping is real learned behavior. But the majority of the apparent improvement is an artifact of a metric that doesn't penalize saying too little. The successor question is obvious: does this pattern hold for larger models and for PO methods beyond the four tested? Lee works exclusively with LLaVA-1.5-7B checkpoints. If the coverage-hallucination tradeoff persists at 13B and 70B scales, that's a field-level finding about how PO interacts with VLM architectures. If it doesn't — if larger models maintain coverage under PO — then this is a small-model artifact. The honest read is that Lee likely didn't have the compute for larger-scale experiments, and the paper is carefully scoped to what can be rigorously demonstrated at 7B.
The analogy
You're a student who raises your test accuracy by answering fewer questions. Your error rate drops, but your teacher eventually notices you're skipping questions you used to get right. The score looks better; the knowledge doesn't.
Test strategy
Answering fewer questions to reduce error rate while losing coverage of known material
PO brevity bias
VLMs name fewer object categories post-PO, reducing hallucination rate while losing recall of real objects
Honest assessment
A clean, single-author diagnostic paper that makes one strong claim and supports it well within a narrow scope: PO hallucination gains on LLaVA-1.5-7B are mostly brevity artifacts. The base-guided restoration is a nice bonus but secondary. The finding matters if it replicates at scale and across architectures — right now it's a sharp provocation aimed at one model family on one benchmark, and the field should replicate before changing course.
What Is CLAIMS?
63
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
3/5
Integrity
3/5
Milestone
2/5
Successor
4/5
What is this paper actually committing to?
Genuine diagnostic insight: PO models reduce hallucination mostly via brevity, not perception. The 58-86% EOS-bias reproduction and 94-96% repetition rate are concrete, committed claims that reframe PO evaluation.
The field fight
Does preference optimization genuinely improve VLM perception, or does it mainly reshape output behavior to game evaluation metrics?
Side A
PO teaches models to suppress unreliable outputs — a real perceptual calibration
Held by: RLHF-V, RLAIF-V, HA-DPO authors, hallucination benchmark optimizers
Side B
PO primarily teaches models to say less, and current metrics reward brevity without penalizing coverage loss
Held by: This paper
Milestone tracker
Unlocks: Field-level re-evaluation of PO hallucination claims across VLM architectures
Current
7B
params
LLaVA-1.5-7B only
Next
13B+
params
Cross-scale replication
~6-12 months if another group picks this up
Verified Facts (6)
Four public PO checkpoints of LLaVA-1.5-7B lower object coverage and name fewer object categories
Positive EOS logit bias on base model reproduces 58 to 86 percent of CHAIRi gain of three checkpoints on two disjoint COCO sets
Negative EOS bias recovers only 2 to 9 percent of lost CHAIR recall; 94 to 96 percent of added mentions repeat categories already named
Base caption of the same image still names about half of the missed object categories
Base-guided restoration brings three checkpoints within one point of base recall on held-out COCO with lower distinct-object hallucination rate than base
18 pages, 6 figures, 19 tables
Practical Implications (3)
If you're evaluating PO-trained VLMs on CHAIR, supplement CHAIRi with recall and F1 metrics — brevity can game the standard metric
Base-guided object restoration is a free inference-time add-on: no retraining, threshold once on a dev set, append missing categories
Before investing in expensive PO training for hallucination reduction, check whether a simple EOS logit bias achieves comparable CHAIRi on your evaluation set
More latest news
Read all