Imagine you're learning to parallel park, but instead of practicing on the same curb every day, a driving instructor watches you fail, diagnoses exactly why — too wide on approach, too late on the wheel turn — and overnight rebuilds the parking lot to force you through that exact weakness until it's gone. Then the instructor watches you fail at the next thing and rebuilds again. That's the core mechanism of CoDA: a vision-language critic watches a robot policy fail in simulation, writes a structured diagnosis, and a generative data engine converts that diagnosis into new environments purpose-built to stress the weakness. The committed claim: a co-evolutionary loop between environment generation and policy learning, mediated by a heterogeneous memory of failures and progress, can close the sim-to-real generalization gap that supervised fine-tuning alone cannot. The paper demonstrates this across four manipulation task families, pushing out-of-distribution success from 5.3% (after SFT) to 27.6% — a 9.5 percentage-point margin over the strongest closed-loop baseline given the same generation budget. On LIBERO-Pro specifically, position perturbation success goes from 25% to 84% over 15 rounds, and instruction perturbation success goes from 1% to 76%. The architecture sits at the intersection of two active research threads: automatic curriculum generation and action-chunked policy learning. CoDA's distinctive contribution is Text2potential, which converts natural-language diagnostic text from a VLM critic into shaped reward potentials for action-chunk value learning. The shaping is designed to preserve the task's optimal policy under standard potential-based shaping assumptions (the Ng et al. guarantee), while providing dense supervision that pure sparse-reward RL cannot. The heterogeneous memory — storing environment construction code, failure diagnoses, and learning progress — serves as the connective tissue that makes co-evolution tractable rather than chaotic. On the ladder, the relevant baselines are closed-loop data generation methods that also use simulation engines to create training environments. CoDA beats the strongest of these by 9.5 points on the headline OOD metric with equivalent generation budgets. The LIBERO-Pro benchmark is a recognized community testbed for long-horizon manipulation under perturbation, which adds integrity. However, all evaluation is in simulation — no physical robot experiments are reported. The paper is honest about this being a simulation-only result, but it means the sim-to-real transfer question, the one that actually matters for deployment, remains untested. The integrity profile is mixed-strong. The authors use a community benchmark (LIBERO-Pro), compare against named recent baselines, and report ablations showing the contribution of each component (memory, Text2potential, progress-guided generation). The generation budget is held constant across methods, which is the right experimental control. Code availability is indicated via the project website. What's missing: no physical experiments, no pre-registration, no independent replication. The 15-round training protocol raises a mild concern about compute cost that isn't fully addressed — how many GPU-hours does co-evolution actually take versus the baselines? The milestone trajectory here is concrete: 27.6% OOD success is useful but not deployment-grade. The implicit next number is ~60-70% OOD success on diverse real-world manipulation tasks with physical hardware in the loop. That probably requires both scaling the generation diversity and closing the sim-to-real gap with real sensor noise, compliance, and contact dynamics. The gap is likely 2-4 years if sim-to-real transfer methods keep improving at current rates. The obvious experiment the authors didn't run is a real-robot evaluation. My honest read: this is (a) compute and logistics cost — physical robot experiments are expensive and slow — combined with (c) strategic sequencing. A sim-only paper with strong benchmark numbers ships faster and establishes priority on the co-evolution mechanism; the real-robot paper is the natural follow-up. The other missing experiment is scaling to more complex, longer-horizon tasks (assembly, tool use, multi-object rearrangement) where the failure-diagnosis bottleneck of the VLM critic likely becomes the binding constraint.
