You know how a kid who grows up with a chess grandparent doesn't just memorize openings — they absorb a way of looking at the board? They'll apply that thinking to games the grandparent never played, puzzles the grandparent couldn't solve. But now imagine two grandparents with conflicting styles: the kid doesn't blend them into something better — they oscillate, playing like one or the other depending on which voice was louder at breakfast. That's the core mechanism this paper uncovers about on-policy distillation in LLMs. The committed claim: on-policy distillation (OPD) transfers a teacher's reasoning behavior — its cognitive style — rather than its answers to specific problems. Training difficulty barely matters, and even problems the teacher never solves are useful training data. This is a characterization result, not a new method. The paper doesn't propose a better distillation algorithm; it runs controlled experiments to explain why OPD generalizes the way it does, and where it breaks. The most striking finding concerns origin relationships. When teacher and student share an origin — meaning the student is a smaller variant from the same model family — OPD produces broad generalization: cross-language transfer, cross-domain transfer, extended reasoning horizons. The student essentially recovers the teacher's capabilities even on distributions far from the training set. Cross-origin pairs (different model families) tell a different story: the student mostly fits the trained distribution and doesn't generalize far beyond it. This is a sharp, actionable distinction that most distillation papers ignore entirely. The double-edged sword arrives in the multi-teacher setting. Because OPD transfers reasoning behavior broadly rather than domain-specific answers, you can't route prompts to domain experts and expect clean separation. Each teacher's influence bleeds across domains. Combining multiple teachers produces a mixture-dependent seesaw: improving one capability degrades another. This isn't a bug to be fixed with better routing — it's structural to how OPD works. The paper frames this as a diagnosis, not a solution. The controlled methodology deserves attention. The authors vary one generalization factor at a time — in-domain distribution shift, cross-domain transfer, multi-teacher mixing — which is exactly the experimental design that most distillation papers skip in favor of aggregate benchmark numbers. The paper is under review, and the abstract doesn't provide specific benchmark names or numerical results, so we're working from the structural claims rather than from performance tables. For practitioners running distillation pipelines today, the implications are concrete. Same-family distillation (Llama-70B → Llama-8B, Qwen-72B → Qwen-7B) should generalize much more broadly than cross-family distillation (GPT-4 → Llama-8B). Multi-teacher distillation needs to be treated as a constrained optimization with explicit capability tradeoffs, not as a free lunch. And the finding that unsolvable problems are still useful training data should change how people curate distillation datasets — you don't need to filter for teacher accuracy. The paper sits in the broader fight about whether distillation is fundamentally a knowledge-transfer problem or a behavior-transfer problem. This work lands firmly on the behavior side, which has implications for how the field thinks about scaling distillation, selecting teacher-student pairs, and building multi-expert systems.
