Imagine you're cramming for an exam using your own messy notes from the semester. Some notes are gold, some are redundant, and some contradict each other. If you just re-read everything linearly, you'll confuse yourself. But if you first sort your notes into three piles — 'what's the situation,' 'what's the plan,' and 'how do I execute' — and throw out the worst ones before studying, you learn faster and remember better. That's exactly the mechanism MDSKILL exploits for RL agents. The committed claim: by decomposing textual skill memories into three functional views (state grounding, action planning, execution control), filtering for quality, and distilling all three views into a shared policy via on-policy self-distillation, agents internalize experiential knowledge more efficiently than any existing self-distillation or skill-augmented RL method — without relying on a stronger external teacher model. The paper reports up to 7.1% improvement on ALFWorld and 8.1% on WebShop over prior SOTA. The architecture sits squarely in the on-policy self-distillation (OPSD) family — the agent generates trajectories guided by its own skill memories, then uses those trajectories as supervision to update its policy. MDSKILL's twist is structural: instead of treating skill memory as a monolithic prompt, it factors memories into three 'views' that each handle a different cognitive function, then applies dynamic quality metrics to filter out noisy or conflicting skills before distillation. This is a prompt-engineering-meets-knowledge-distillation hybrid that doesn't require architectural changes to the underlying model or additional compute at inference. The ladder comparison is honest but circumscribed. The baselines include RL methods (ReAct, Reflexion), skill-augmented methods (SKILL, AutoGuide), and self-distillation baselines (AgentTrek). The explicit constraint is no stronger external teacher — so GPT-4-distilled methods are excluded by design. Within that constraint, the gains are real: +7.1% on ALFWorld, +8.1% on WebShop, and the paper also evaluates on ScienceWorld. However, the absolute performance numbers and whether teacher-distilled methods still dominate at these benchmarks is left as an open question the reader should track. Integrity is mixed. Three established agent benchmarks (ALFWorld, WebShop, ScienceWorld) provide reasonable community validation, and ablations are extensive — each view is ablated individually, quality filtering is toggled, and evolution curves are plotted. Code is provided via anonymous repository. But there's no pre-registration, no independent replication, and the quality filtering thresholds introduce hyperparameter choices that could be tuned post-hoc. The paper acknowledges limited training budgets as a constraint, which is honest, but also means the method hasn't been stress-tested at scale. The milestone question points toward generalization and scale. Current gains are demonstrated on three benchmarks with limited training budgets. The next meaningful number would be consistent improvement on a broader agent benchmark suite (5+ diverse environments) with larger policy models, demonstrating that multi-view decomposition scales rather than saturating. The gap is probably 1-2 years — the infrastructure exists, the question is whether the view-decomposition trick remains useful as base models get stronger. The obvious experiment not run: testing MDSKILL on top of already-strong teacher-distilled policies. The paper explicitly excludes teacher-distilled baselines to isolate the self-evolution contribution, which is a clean experimental choice. But the practical question everyone will ask is whether multi-view distillation is additive on top of GPT-4-bootstrapped agents. My read: they're saving this for the next paper, since showing additive gains on top of teacher distillation would be a strictly stronger result and a natural follow-up.
