Imagine you're judging a cooking competition. You taste a dish made by a team of three chefs and declare it better than one chef working alone. But wait — was the improvement because the team had diverse ideas, or because three people in the kitchen changed the head chef's behavior even when they all brought the same ingredient? If you don't control for that, you don't know what you're measuring. That's exactly the problem this paper dissects for LLM ensembles. The committed claim: the gain from adding candidates to an LLM aggregator is not a single number — it decomposes algebraically into two distinct contrasts depending on which non-diverse baseline you choose, and the community has been conflating these contrasts. The paper introduces a formal decomposition where overall candidate improvement value (CIV) splits into a diversity-specific value (DSV) and a candidate-context value (CCV). Crucially, CIV stays the same regardless of control, but DSV and CCV swap depending on whether you compare against a Single-slot control (one candidate in a multi-slot prompt) or a Duplicate control (one candidate repeated to fill all slots). The mechanism is tested on two benchmarks: MultiHopRAG with k=2 candidates, and a 200-sample stronger-panel extension of FRAMES with k=3 and a 4096-token aggregator output limit. The results are striking. On MultiHopRAG, the repetition gap Rep = −8.33 percentage points, meaning gains look 8.33 pp larger when measured against Duplicate than against Single-slot. On FRAMES, paired Delta Rep flips to +9.67 pp. Within FRAMES panels, Rep itself changes sign: −6.33 for the original panel vs +3.33 for the stronger panel. This sign-flip is the paper's sharpest empirical finding — it means the same ensemble setup can appear to benefit from diversity or suffer from it depending entirely on which control you chose and which panel you're looking at. Architecturally, this is not a new ensemble method — it's a measurement paper. The aggregator is an LLM that receives candidate responses and produces a final answer. The paper's contribution is the algebraic decomposition itself, plus the experimental design (four matched conditions: Direct, Single-slot, Duplicate, Multi-candidate) that cleanly isolates what each contrast measures. The candidate-context contrast (CCV) remains strongly negative on FRAMES under both controls, meaning the mere presence of candidate slots in the prompt degrades aggregator performance on evidence aggregation tasks even when candidates carry no new information. Integrity is mixed. The experimental design is clean and the decomposition is algebraic (not statistical), which is a strength — the identity holds by construction. But the sample sizes are modest (MultiHopRAG not specified beyond k=2; FRAMES n=200), confidence intervals are reported but wide, and there's no independent replication. The benchmarks are community-standard (MultiHopRAG, FRAMES), which is good. The paper is transparent about when effects change sign and doesn't cherry-pick the flattering direction. Code availability is not stated. The practical upshot is methodological, not architectural. If you're publishing ensemble results, this paper argues you must specify your reference control or your reported gains are ambiguous. The repetition gap Rep quantifies exactly how much your choice of baseline inflates or deflates your headline number. For practitioners running LLM ensembles in production, the negative CCV finding on FRAMES is a concrete warning: stuffing candidate slots into your aggregator prompt has a cost even when candidates are identical, and that cost can dominate on evidence-heavy tasks. What's missing is scale. The paper tests k=2 and k=3 candidates. The obvious next experiment is scaling to k=5 or k=10 to see whether DSV and CCV scale linearly or whether there are diminishing or accelerating returns. The authors likely ran out of compute budget — this reads as a single-author paper with limited resources, not a withheld result.
