Imagine you're a spell-checker for English, and someone hands you text where all the vowels have been replaced with 'a.' You'd still catch most typos — 'tha' is probably 'the,' 'hasa' is 'house.' Now imagine a language where removing the little marks above and below vowels turns one word into five different words. That's Vietnamese without diacritics, and it's the core finding of this paper: the thing that breaks zero-shot classifiers isn't slang or typos — it's the systematic erasure of tonal markers that makes words ambiguous. The committed claim: four specialized decision models (NLI-based zero-shot classifiers including JEV, GLiNER, and others) were evaluated across 13 classification settings spanning six Vietnamese task groups, and the results map which failure modes actually matter. Under English label descriptions, JEV ranks first in 11 of 13 settings. But the real story is the robustness analysis — diacritic removal drops macro-F1 by 9.51 to 15.47 points, roughly 2-4× worse than teencode (Vietnamese internet slang) or typographical noise. The architecture space here is NLI-based zero-shot classification — models trained on natural language inference (entailment/contradiction) that generalize to unseen label sets by treating classification as a textual entailment problem. These are 'decision models' in the sense that they route inputs to labels without task-specific fine-tuning. The paper tests four such models but doesn't propose a new one; this is an empirical audit, not a methods contribution. On the ladder: there's no strong prior benchmark specifically for Vietnamese zero-shot robustness at this breadth. The paper is filling a gap rather than beating a known number. The six task groups and 13 settings give reasonable coverage, but the baselines are the models themselves under different conditions (English vs. Vietnamese vs. bilingual labels), not competing Vietnamese-specific systems. This means the ladder contribution is 'here's where things stand' rather than 'we advance the frontier.' Integrity is mixed. The evaluation covers real perturbation types that matter in production Vietnamese NLP — teencode, typos, and diacritic removal are the three dominant noise sources in Vietnamese web text. But the paper doesn't appear to release code or data artifacts, and there's no pre-registration. The perturbation pipeline itself (how teencode was generated, which diacritics were stripped) is a potential source of variance that would need replication to trust fully. The milestone this points toward is clear: robust Vietnamese zero-shot classification that survives diacritic-free input without catastrophic degradation. Today, a 9-15 point F1 drop means these models are unreliable on informal Vietnamese text (chat, social media, SMS) where diacritics are routinely omitted. The threshold for practical deployment would be diacritic-removal degradation under 3 points — roughly where typo noise sits now. That's the number to track. The obvious experiment not run: fine-tuning or augmenting the decision models with diacritic-stripped training data to measure whether the fragility is architectural or just a training-distribution gap. The honest read is (a) — this team was running an evaluation study, not a training study, and augmentation experiments require compute and infrastructure they likely didn't scope. But it's the first thing any practitioner would try, and the answer matters enormously for whether the diacritic problem is fixable cheaply or requires architectural changes.
