Imagine you're a translator working between a doctor and a patient who speaks a different language. You could translate word-for-word and preserve every clinical nuance — but the patient won't understand. You could paraphrase freely and the patient will follow — but you might accidentally change the diagnosis. This paper measures exactly where that tradeoff bites when LLMs do the translating, and whether giving the translator a cheat sheet (structured evidence constraints) helps them stay honest. The committed claim: constrained generation frameworks — combining structured evidence conditioning with Retrieval-Augmented Generation (RAG) — consistently improve the clinical faithfulness of LLM-generated patient health summaries, specifically for menstrual health monitoring. The improvement is measurable via Natural Language Inference (NLI) entailment scores, atomic factuality metrics, and uncertainty preservation. But improved alignment comes with a concrete cost: higher reading difficulty and denser medical terminology. The experimental setup is methodical if not enormous. Three LLMs generate 4,500 summaries from structured menstrual health records, evaluated across multiple axes: faithfulness (does the summary say what the data says?), omission (does it leave things out?), uncertainty preservation (does it preserve hedges and probabilistic language from the source?), and readability. The constrained pipeline consistently lifts faithfulness and uncertainty preservation. Omission effects are model-dependent — some LLMs drop facts even with grounding, others don't. The readability penalty is consistent across all models: grounded summaries are harder to read. Architecturally, this is prompt-based constrained generation plus RAG — not fine-tuning, not RLHF, not specialized medical LLMs. The evaluation relies on NLI-based semantic alignment, which is a reasonable proxy for clinical fidelity but not a substitute for expert clinical review. The authors evaluate against retrieved evidence (not just the original structured record), which is a useful integrity move — it means faithfulness is graded against what the model was actually shown, not just the ground truth. The integrity picture is decent but not airtight. The evaluation is automated (NLI, readability scores), not clinician-validated. There's no pre-registration, no independent replication, and no code release mentioned. The 4,500 summaries across 3 models gives reasonable statistical coverage, but the domain is narrow (menstrual health), and the structured records appear to be from a single source pipeline. The key finding — that grounding helps but hurts readability — is plausible and well-supported within the study's scope, but generalizing to other clinical domains would require new evidence. The real contribution here is the evaluation framework, not the generation method. Jointly measuring faithfulness, uncertainty preservation, omission, and readability is the right move for patient-facing medical NLP, and most prior work doesn't do all four. The tension they surface — clinical precision vs. patient accessibility — is the central design problem for anyone deploying LLMs in health communication. This paper doesn't solve it, but it quantifies the tradeoff cleanly enough that others can build on it. The obvious next experiment is clinician evaluation: do human doctors agree with the NLI-based faithfulness scores? And the obvious scaling question is whether these findings hold across diverse clinical domains (cardiology, oncology, diabetes) or are specific to the relatively structured menstrual health domain. The authors likely didn't run clinician evaluation because it's expensive and slow — a resource constraint, not a methodological dodge.
