Imagine you're coaching a junior developer who keeps shipping buggy features. You wouldn't send them back to a bootcamp every time — you'd first check: is the bug in their code logic (the harness), or do they genuinely not know how to write a certain kind of function (the skill)? Only if it's a skill gap do you invest in targeted training. AdaRSI applies exactly this triage to robotic manipulation. The committed claim: a self-improving embodied agent can diagnose whether a failure stems from how its low-level executor is called (orchestration) or what the executor can physically do (motor skill), then selectively fine-tune only the broken motor skills — with demonstrations it generates itself, no human in the loop. On 50 unseen composite tasks in RoboCasa365, this raises success from 4.6% to 13.8% while burning only 28% of the GPU hours and 22% of the training demonstrations compared to fine-tuning everything. The architecture is a two-layer stack. The outer layer is a code-generating LLM agent (the "coding agent") that writes and rewrites task decompositions and skill calls — essentially the orchestration harness. The inner layer is GR00T N1.5, NVIDIA's vision-language-action model, which actually moves the robot. When the coding agent's rewrites can't fix a sub-step, AdaRSI replays that sub-step from saved simulator states, collects its own demonstrations of success and failure, and fine-tunes GR00T only on the persistently broken sub-steps. This is the key structural choice: attribution before fine-tuning, not fine-tuning as the first resort. The ladder context matters. The absolute numbers are still low — 13.8% success on unseen composite tasks is not deployment-ready. The prior art includes Inner Monologue and ReKep-style harness-only self-improvement, which can fix orchestration but cannot add missing motor primitives, and blanket VLA fine-tuning approaches that retrain everything without diagnosing what's actually wrong. AdaRSI's contribution is not raw success rate but diagnostic efficiency: it reaches slightly higher success than full fine-tuning at a fraction of the compute. Integrity is mixed. All evaluation runs in RoboCasa365 simulation, not on physical hardware. The benchmark is a known community environment, which is good, but the authors are grading their own method's self-collected demonstrations — a somewhat circular loop. There's no mention of code release or pre-registration. The comparison to "fine-tuning without a harness" and "fine-tuning every sub-step" is fair and informative, but the absence of comparison to other recent self-improvement frameworks like Voyager or EUREKA in this exact setting leaves a gap. The milestone question is where this gets interesting. The 4.6% → 13.8% jump on composite tasks shows the mechanism works, but the field needs to cross roughly 70-80% success on multi-step tasks before any of this matters for real deployment. The gap between 13.8% and 70% is enormous — likely requiring not just better triage but fundamentally more capable base VLAs, better sim-to-real transfer, and richer self-demonstration collection. The honest read on the successor experiment: transferring this to physical hardware is the obvious next step the authors didn't run, almost certainly because sim-to-real transfer for fine-tuned VLAs remains brutal, and a negative result on real hardware would undercut the paper's narrative. They're likely working on it for the next paper. The broader field fight here is about how embodied agents should self-improve: should we build ever-larger pretrained VLAs and hope generalization emerges (the scaling camp), or should we build modular self-improvement loops that diagnose and patch failures incrementally (the RSI camp)? AdaRSI is firmly in the RSI camp, and its most interesting contribution is the principled separation of orchestration failures from skill failures — a distinction that will survive even if the specific numbers don't.
