Imagine you're hiring two translators for a noisy phone line. Both score 65% on a vocab quiz — identical. But one consistently confuses 'left' with 'right,' while the other confuses 'left' with 'up.' When you're navigating a maze by their translations, the first translator is catastrophic — the planner can never tell the two most critical directions apart — while the second is merely noisy. The quiz score told you nothing about which translator would get you killed. That's the core mechanism of this paper: accuracy averages over all confusions equally, but sequential planners live or die by the worst confusion pair. The committed claim: in sequential brain-to-robot control, single-trial decoder accuracy is a fundamentally misleading metric. The authors formalize the control loop as a POMDP and prove a sharp phase transition — regret stays bounded if every pair of goals is decoder-distinguishable, and grows linearly if even one pair isn't. The boundary is set by a single number: the worst-pair Chernoff information, Γmin. They then derive a closed-form regret predictor Uid(C) computable from any confusion matrix in O(K²) time. The killer demonstration: two EEG decoders tested on the BNCI2014001 dataset (subject 5) both hit exactly 35.1% validation accuracy. Identical by every standard evaluation. Yet one produces 9.6× more cumulative planning regret than the other when deployed in a sequential task. Uid correctly predicts this gap; accuracy cannot. This is not a marginal improvement — it's a diagnostic that catches pathological failure modes invisible to the standard metric. Architecturally, this sits in the information-theoretic analysis tradition applied to POMDPs, not in the neural decoder design space. The method is agnostic to the decoder architecture — it operates on the confusion matrix, making it a post-hoc diagnostic tool rather than a training objective. The Chernoff information framework borrows from hypothesis testing theory and channel coding, repurposed here to characterize how quickly a Bayesian planner can distinguish between intended goals given noisy decoder outputs. The validation spans two domains with orthogonal information channels — EEG-based motor imagery and a second domain confirming Uid's advantage with decoders spanning independent feature channels. The mathematical proof of the phase transition provides formal grounding beyond empirical demonstration alone. The BNCI2014001 dataset is a community benchmark, which helps, though the subject-specific result (subject 5) raises questions about generalizability across the population. The practical implication is immediate: any BCI lab can compute Uid from their existing confusion matrices right now, at negligible cost. If you're selecting between decoders or sensors for assistive robotics, this metric catches traps that accuracy misses entirely. The 9.6× regret difference on identical accuracy is the kind of failure mode that could mean the difference between a usable assistive system and a dangerous one. What's missing is scale validation. The pathological case is demonstrated on a single subject. The theory is general, but whether accuracy traps are common or rare across subjects, tasks, and decoder families remains an empirical question the paper doesn't fully resolve. The obvious next experiment — running Uid-guided decoder selection across a full cohort and measuring downstream task performance in a real robotic system — would be the load-bearing test.
