Imagine you're assembling a trivia team. The Neural Thickets hypothesis says there are brilliant specialists hiding in nearby seats — you just need to tap them on the shoulder (perturb the weights) and they'll stand up. This paper says: no, you can get the same team performance by giving the same person slightly different answer sheets (random logit noise), picking the best-looking sheets on a practice round, and then majority-voting. The specialists were never there; the diversity was doing the work all along. The committed claim: the performance gains reported by Neural Thickets (Ramanujan et al.) do not require the geometric explanation that pretrained models sit in dense neighborhoods of task-specific experts in weight space. Instead, random perturbations to output logits — applied to a completely frozen model — match or exceed full-weight perturbations on most reasoning benchmarks. The mechanism is output diversity, validation-based selection, and voting, formalized as Perturb-Select-Vote (PSV). The evidence ladder is well-constructed. The authors reproduce the original Neural Thickets gains, then systematically ablate. Perturbing only a single decoder block recovers much of the improvement. Logit-only PSV — adding a random bias vector to the output logits with zero weight changes — matches or beats full-weight perturbation on most reasoning tasks. A first-order Taylor analysis shows why: small weight perturbations act primarily through their induced logit shifts, so the weight-space geometry is downstream of the output-space effect, not the cause. Architecturally, this sits in the inference-time compute family alongside self-consistency (Wang et al. 2022), verifier-guided selection, and classic ensemble methods. The key structural insight is that PSV decomposes any perturbation ensemble into three separable stages: generate diverse predictions, select high-performing members on a small validation set, aggregate by voting. This decomposition makes the method training-free and model-agnostic — it works on frozen checkpoints with no gradient computation. The integrity picture is solid for a rebuttal paper. The authors reproduce the original results before dismantling them, which is the right protocol. They test across both language (reasoning benchmarks) and vision (including domain shift on Earth observation data), where logit PSV substantially improves performance while full-weight perturbations provide little additional benefit. The vision extension is particularly telling — it rules out language-specific confounds. The main limitation is that benchmark selection appears post-hoc rather than pre-registered, and there's no independent replication yet. The milestone framing here is conceptual rather than numeric: the real unlock is whether inference-time diversity methods can replace fine-tuning ensembles entirely for domain adaptation. If logit PSV scales to larger models and harder distribution shifts — say, medical imaging or multilingual reasoning — you'd have a zero-training-cost alternative to model ensembles that currently require N× the storage and compute. The obvious next experiment is scaling logit PSV to much larger models (70B+ parameters) and harder benchmarks (MATH, competitive programming, multi-step agentic tasks), and comparing head-to-head against sample-then-verify pipelines like those used in o1-style inference scaling. The authors likely didn't run this because compute cost scales linearly with ensemble size at those model scales, and the paper's argumentative goal — dismantling the weight-space geometry claim — doesn't require it. But it's the experiment that would make practitioners switch.
