Imagine you're training a new line cook. You could hand them a recipe book (a VLA model), or you could let them cook, fail, annotate their own recipe cards with notes like "reduce heat after searing" and "this sauce breaks if you add butter too fast," then pass those annotated cards to the next hire. EmbodiedEvo is the second approach, except the cook is an LLM and the kitchen is a simulated robot workspace. The core claim: a code-generating agent can evolve a library of reusable Skills (executable procedures) and Lessons (failure-derived heuristics) on a single training scene, freeze that library, and deploy it across diverse new tasks — achieving state-of-the-art results on the RoboDojo-Sim benchmark with a 37.82% success rate and average score of 44.48. This is the top officially verified result on that leaderboard. The key architectural choice is treating code as both the policy representation and the workspace — the agent writes, runs, inspects output, revises, and builds up a persistent experience store, rather than following a fixed plan-execute-verify pipeline. The ladder question is instructive. EmbodiedEvo surpasses all officially verified results on RoboDojo-Sim, but the paper doesn't name a specific prior method with a number to beat — it positions against the general category of VLA models and raw code-generation baselines. The ablation is more revealing: Skills and Lessons achieve comparable task performance to raw interaction history at 53% lower execution cost, and experience from a stronger model (Astra) lifts weaker models (Sol, Luna) by 8.86 and 5.50 percentage points respectively. That cross-model transfer is the result that matters most. Architecturally, this sits in the SWE-agent family — LLMs operating in a code-edit-execute loop with tool use — extended to embodied simulation. The agent isn't learning weights; it's accumulating structured text artifacts (Skills as reusable code snippets, Lessons as natural-language heuristics) that get injected into future prompts. The compute property it leans on is the LLM's in-context learning and code generation capability, not gradient updates. This makes it lightweight to deploy but entirely dependent on the base model's code quality. Integrity is mixed. The benchmark (RoboDojo-Sim) is a community benchmark with official verification, which is a genuine strength. But the training regime — evolve on one Playground scene, test on diverse scenes — raises the question of how much the Playground scene was tuned to produce good Skills. The paper acknowledges that fine contact control remains difficult, which is honest, but the 37.82% success rate means the agent fails more often than it succeeds. Paired statistical tests are used for the ablation claims, which is good practice. The milestone that matters: 37.82% success rate today. The obvious next threshold is ~60-70% — the point where an embodied coding agent becomes reliable enough for semi-autonomous real-world deployment rather than a research curiosity. The gap between simulation and physical hardware remains the elephant in the room. The paper operates entirely in simulation; no physical robot results are reported. The experiment they didn't run — and the most glaring omission — is sim-to-real transfer. Every claim here lives in RoboDojo-Sim. The honest read: this is almost certainly (a) they need hardware access and time, combined with (c) sim-to-real is the obvious next paper. The experience-transfer result (stronger model helping weaker ones) is the seed of a follow-up on distillation-via-experience, which they're likely already running.
