Imagine you're a sous chef learning to plate dishes under a Michelin-starred mentor. The mentor doesn't just say "7 out of 10" — she narrates as she works: "The sauce pools here because the viscosity is off, the garnish is placed for symmetry but blocks the protein visually, and the color contrast needs acid." You absorb the reasoning chain, and eventually you can plate — and explain your plating — on your own. That's the core mechanism of HiFTS: a teacher LLM generates structured, rubric-grounded chain-of-thought feedback for each essay trait, and a smaller student model learns to reproduce that entire reasoning sequence before committing to numeric scores. The committed claim: a single autoregressive model that generates hierarchical feedback AND predicts multi-trait scores in one pass outperforms systems that decouple these tasks or treat traits independently. This is not the first feedback-enhanced AES system, but HiFTS is arguing that the coupling — feedback literally preceding scores in the same generation sequence — is what matters. Prior methods like RLHF-enhanced scorers or separate feedback modules break the reasoning chain. HiFTS keeps it intact. Architecturally, we're in teacher-student distillation territory with an RLHF-adjacent alignment step. The teacher is a large LLM (likely GPT-4-class, though the paper uses the generic "teacher LLM") that produces hierarchical CoT annotations: trait-level observations rolled up into holistic judgments. The student — fine-tuned via LLaMA-Factory on a LLaMA backbone — first warms up with supervised fine-tuning on these teacher sequences, then gets aligned using Group Relative Policy Optimization (GRPO) with a composite reward that balances four signals: score agreement with human annotations, calibration across the score range, feedback quality, and structural validity of the output format. PPO appears only as an ablation. At inference time, a BERT-based holistic prior is prepended to the system prompt — essentially a lightweight "here's roughly how good this essay is" signal to prevent the model from drifting during long-form reasoning. The ladder here is tricky to read from the abstract alone. The paper tests on two benchmarks: ASAP++, the community-standard English multi-trait AES dataset, and CFMS-34, a new Chinese dataset the authors themselves introduce. CFMS-34 contains 951 dual-rated primary-school essays annotated across 34 rubric-based traits — a genuinely useful contribution, since Chinese AES data at this trait granularity is scarce. But 951 essays is small. The paper claims "strong holistic and trait-level scoring" on both datasets, but without specific QWK numbers in the abstract, we can't confirm whether it beats current SOTA (likely systems like AEG or ChatGPT-based AES approaches from 2024-2025) or merely matches. Integrity is mixed. Using ASAP++ is the right move — it's the standard community benchmark. But evaluating on your own dataset (CFMS-34) that you also designed the annotation scheme for introduces circularity risk. The rubric was designed, the teacher feedback was generated, and the student was trained all within the same team's conceptual framework. Code is released on GitHub, which is strong. No pre-registration, no independent replication yet — standard for the field, but worth flagging. The obvious experiment they didn't run: scaling CFMS-34 to thousands of essays, or testing on a third-party Chinese AES benchmark they didn't design. My read is (a) — annotation cost. Getting 34-trait dual-rated annotations on Chinese essays is expensive and slow. 951 essays with that annotation density is already a significant annotation effort. Scaling 5-10x would require institutional funding they may not have had. The second missing experiment: applying HiFTS to a non-essay structured-writing task (technical reports, college applications) to test whether the hierarchical feedback mechanism generalizes beyond primary-school compositions.
