Imagine you're learning to ride a bike with training wheels. The training wheels aren't just keeping you upright — they're routing you through specific balance corrections your body hasn't learned yet. Now imagine a coach who watches how the training wheels correct your lean angle, translates those corrections into verbal instructions you can follow without the wheels, and drills you on those instructions until the muscle memory sticks. That's Harness-Zero: the coach is an 'agent-as-harness' that translates specialized scaffolding behavior into demonstrations the student model can actually learn from, so the scaffolding can be removed at test time. The committed claim: distilling the behavior induced by domain-optimized agent harnesses (the external systems — prompts, tools, parsers — that sit between an LLM and its environment) into model weights via an intermediate 'harnessing agent,' such that the fine-tuned model exceeds harness-attached performance on the original harness at deployment. The key number: base model jumps from 23.3% to 44.3% macro-average task success after distillation, surpassing the 41.7% it achieves with the specialized harness still attached. The core technical problem is an action-space mismatch. An optimized harness might expose different tools, different output formats, or different information than the target deployment harness. You can't naively use the optimized harness's outputs as supervision because the student literally cannot produce those outputs in its deployment environment. Harness-Zero's solution is a two-stage pipeline: first, a capable LLM (the harnessing agent) observes the student's response, receives guidance from the optimized harness, and produces a corrected response in the target harness's action space. Second, the resulting trajectories become fine-tuning data. This is clever because it decouples the source of behavioral knowledge (the optimized harness) from the format of the training signal (target-harness-compatible demonstrations). The ladder position is genuinely interesting. The paper compares agent-as-harness against code-as-harness (where the harness logic is expressed as executable code rather than mediated by an agent) and shows the agent approach outperforms on frontier LLMs. The 82.3% average recovery rate across 28 behavioral patterns in three domains (knowledge work, tool use, science) is a strong signal — it means the method isn't just boosting aggregate scores but actually transferring specific harness-induced behaviors. The domains are heterogeneous enough to suggest generality, though all evaluations appear to be the authors' own benchmarks or adaptations. The integrity picture is mixed. Three domains is better than one, and 28 behavioral patterns across them is a reasonable granularity for measuring what actually transferred. But the validation is entirely same-team: the authors designed the harnesses, the harnessing agent, the evaluation, and the behavioral pattern taxonomy. There's no independent benchmark and no pre-registration. The headline result — distilled model beating harness-attached model — is surprising enough to warrant external replication. It could be that the harness introduces friction at deployment that the internalized behaviors avoid, which would be a real but different story than 'distillation exceeds the teacher.' The milestone framing here is about generality: can this approach scale to N arbitrary harnesses across M domains without per-domain harnessing agent design? The current demonstration covers three domains. The practical unlock would be a harness-agnostic distillation pipeline that works as a standard post-training step — essentially making agent scaffolding a training-time concern rather than a deployment-time dependency. That's probably 2-3 iterations away. The obvious experiment not run: distilling from multiple specialized harnesses simultaneously into a single model and measuring whether behaviors compose or interfere. My honest read is (c) — they're saving it for the next paper. The single-harness-to-single-model pipeline is the clean story; multi-harness composition is the obvious sequel that would make this a platform rather than a technique.
