Imagine a spell-checker that flags every word written in French as a typo — not because the words are misspelled, but because French words are rare in an English corpus. The spell-checker isn't measuring spelling quality; it's measuring frequency. That's exactly what happens when selective prediction systems use standard uncertainty scores on imbalanced clinical datasets. The uncertainty metric stops measuring "I'm not sure about this patient" and starts measuring "patients like this are rare in my training data." The result is a system that looks safe by aggregate metrics while systematically deferring every minority-class patient — the very patients the model is supposed to help — to human review, or worse, quietly excluding them. The committed claim: under clinical class imbalance, standard uncertainty quantification (e.g., predictive entropy) becomes a proxy for class membership rather than clinical ambiguity, and this creates a correctable structural flaw, not an inevitable limitation. The authors demonstrate that this isn't a calibration problem or a threshold-tuning problem — it's a monotonicity failure. When you apply class-conditional referral (CCR) with standard entropy and set your deferral threshold at τ=0.5, the within-class monotonicity property breaks. Patients who should be clearly classifiable get deferred because they belong to the minority class, while genuinely ambiguous majority-class patients sail through. The evaluation spans 56 synthetic conditions plus three real neurodegenerative cohorts — multiple sclerosis, Parkinson's disease, and Alzheimer's disease — covering the spectrum from severe imbalance to near-balanced conditions. This is a serious experimental design. The synthetic conditions let them control the imbalance ratio and verify the theoretical predictions, while the clinical cohorts ground the work in real prognostic tasks. The fix is combining CCR with threshold-aware uncertainty metrics that restore strict within-class monotonicity, meaning the system correctly identifies ambiguous patients regardless of which class they belong to. Architecturally, this is a calibration-layer and evaluation-framework paper, not a new model. It sits in the selective prediction family — systems that can say "I don't know" and defer to a human. The key structural insight is about how uncertainty scores interact with decision thresholds under imbalance, which makes it agnostic to the underlying classifier. The method leans on the mathematical properties of entropy under skewed class distributions and proposes class-stratified evaluation as the integrity check that global metrics fail to provide. The integrity story is mixed in useful ways. The synthetic-plus-clinical design is strong — the synthetic conditions let you verify the mechanism, the clinical cohorts verify it matters in practice. Code is released on GitHub. The weakness is that all three clinical cohorts are neurodegenerative diseases; the structural argument should generalize to oncology, cardiology, and other domains with prognostic imbalance, but that hasn't been demonstrated. The baselines compared against are standard entropy and global evaluation metrics, which are the right things to compare against for diagnosing the structural flaw, though the paper doesn't compare its corrected framework against other proposed imbalance-aware uncertainty methods. The milestone question is about adoption, not performance. The technical fix is relatively lightweight — threshold-aware metrics and class-stratified evaluation are implementable today. The real barrier is institutional: clinical AI pipelines need to replace their global evaluation dashboards with class-stratified ones, and regulatory frameworks need to require this. The next concrete number to watch is how many FDA-cleared or CE-marked clinical AI systems adopt class-stratified selective prediction evaluation. Currently that number is effectively zero. The obvious experiment not run: applying this framework to a deployed clinical system with real deferral-to-human outcomes, measuring whether the corrected uncertainty scores actually change clinical decisions and patient outcomes. The honest read is (a) — this requires institutional partnerships and IRB approvals the authors don't have, not a compute problem. The paper is a diagnostic and a correction at the evaluation layer; the clinical deployment study is a different kind of project entirely.
