You know that feeling after an exam where you walk out and suddenly realize question 7 was wrong — even though during the exam you felt fine about it? That's the core mechanism this paper studies in LLMs, except the models never get the stomach-drop moment. They remain confident even when they hallucinated the answer. Sahil Kale borrows two concepts from cognitive psychology's meta-memory literature: Feeling-of-Knowing (FOK), where a model rates its confidence before attempting the problem, and Judgement-of-Learning (JOL), where it rates confidence after generating an answer. The committed claim is that these two signals encode structurally different epistemic information, and that the distinction matters for practical deployment — especially outside English. FOK is cheap (one inference pass to get a confidence score before full generation), but Kale finds it remains only weakly calibrated across settings. JOL costs more (you need the full answer first), but provides meaningfully stronger alignment between stated confidence and actual correctness. The ladder here is positioned against the growing body of LLM calibration work — Kadavath et al. (2022), Xiong et al. (2024), and the broader uncertainty-quantification literature. The paper doesn't claim to beat any SOTA calibration method; rather, it reframes the question temporally and cross-lingually. Two frontier models are tested (likely GPT-4-class and Gemini-class, though the abstract doesn't name them) across multiple reasoning domains. The real contribution is the cross-lingual dimension: when MMLU-style benchmarks are translated into Marathi, calibration trends largely survive. But when genuinely local Marathi questions are asked — facts a Marathi speaker would know but which aren't in English training corpora — confidence degrades substantially while the model's stated confidence does not. The models don't know what they don't know about Marathi-specific knowledge. Architecturally, this is a probing study, not a new model or training procedure. The method is prompt-based elicitation of verbal confidence scores at two temporal stages, evaluated via standard calibration metrics (likely ECE, Brier score, reliability diagrams). The 7 figures across 10 pages suggest a thorough empirical sweep. The newly constructed local Marathi benchmark is a genuine contribution — most multilingual NLP work stops at translation of English benchmarks and never tests whether models actually possess local knowledge. The hallucination finding is the sharpest result: after generating a hallucinated answer, models maintain elevated confidence in the JOL stage. This means post-solve confidence, while better than pre-solve, still cannot be trusted as a hallucination detector. For anyone building retrieval-augmented or confidence-gated systems, this is a concrete design constraint: you cannot simply threshold on JOL confidence to catch bad outputs. The paper's limitation is scope. Ten pages at a workshop (WiNLP @ EMNLP 2026) means this is a position-establishing piece, not a definitive study. The Marathi focus is valuable but also a single-language test of the cross-lingual hypothesis. The real question — does this FOK/JOL distinction hold across 20+ typologically diverse languages and dozens of local knowledge domains? — is explicitly left open. The honest read is that this is a well-framed pilot study that names the right problem (temporal structure of confidence × linguistic coverage) and provides initial evidence, but the heavy lifting remains ahead.
