
Read the paper
One Policy for 100 Household Tasks: Our Solution for the 2026 BEHAVIOR Challenge
on GitHub
Imagine you're training a single short-order cook to handle every dish on a 100-item diner menu. Most competition kitchens would hire specialists — one person for eggs, another for grill — but this team bets that a single cook, trained longer and more carefully on the full menu, will generalize better than an army of narrow experts. That's the core bet here: one vision-language-action (VLA) model, one checkpoint, all 100 long-horizon household tasks in the OmniGibson simulator. When 14 dishes still come out undercooked, they bring in a sous-chef — a GPT-6 Astra coding agent — who watches the kitchen through the same cameras but writes motion-planning code instead of predicting actions directly. The committed claim: a single VLA model built on π₀.₅ can handle 100 diverse, long-horizon manipulation tasks in simulation, scoring Q=0.392 across the full set, up from Q=0.260 on the 50-task subset from their 2025 first-place solution. The team placed 9th on the final leaderboard and were the only independent (non-corporate) team in the top 10. The headline number with the Astra routing included was Q=0.446 with 27.3% full-task success. These are real numbers in a hard benchmark — long-horizon tasks with multi-step semantic structure, not single-grasp pick-and-place. The architecture is a flow-matching VLA descended from π₀.₅, operating over a 21-dimensional action space matched to teleoperation controls. The team's core 2026 insight was unglamorous: the 2025 model was simply undertrained. So the work focused on scaling training — 200k steps over 211M demonstration frames (roughly one epoch), variance-reduced multi-sample flow matching with a noise-vs-compute model that picks sample counts per observation without ablations, task and stage embeddings warm-started from semantically similar tasks, and cloud infrastructure running six simulators per GPU faster than real time. The Astra coding agent, deployed on 14 tasks where the learned policy scored only Q=0.108, achieved Q=0.639 on those same tasks — a 6× improvement — by starting each episode from a frozen copy of its own practice session. On the ladder, the primary baseline is the team's own 2025 first-place solution. The Q improvement from 0.260 to 0.371 on the shared 50-task subset represents a 43% relative gain. Against other 2026 competitors, 9th place out of the full leaderboard is honest positioning — this is not SOTA, but it's the best independent-team result. The paper does not compare systematically against other published VLA architectures (Octo, OpenVLA, RT-2) on the same benchmark, which is a gap, though the BEHAVIOR leaderboard itself provides implicit comparison. Integrity is mixed. The BEHAVIOR Challenge is a legitimate community benchmark with standardized evaluation, and the team releases code, checkpoint, and project page. But validation is entirely in simulation (OmniGibson), there's no sim-to-real transfer, no pre-registration, and the Astra routing decision (which 14 tasks to hand off) was made post-hoc based on observed performance gaps. The cloud evaluation infrastructure with provenance tracking and restorable simulator states is a genuine contribution to reproducibility, but no independent replication exists yet. The milestone question is about sim-to-real and task count. Today: 100 simulated tasks, Q≈0.4, zero real-robot hours. The next meaningful threshold is probably Q>0.7 on 100+ tasks in simulation with demonstrated sim-to-real transfer on at least a handful, which would make this architecture a serious candidate for general-purpose home robots. That's likely 2-4 years away given the pace of VLA scaling and sim-to-real work at labs like Physical Intelligence, Google DeepMind, and Toyota Research. The obvious experiment not run: sim-to-real transfer on even a single task. The honest read is (a) — this is a competition entry from an independent team without access to physical robot hardware at the scale needed. The paper is explicit that the entire pipeline lives in simulation. A secondary gap is the absence of systematic ablations on the Astra routing threshold — why 14 tasks and not 20 or 30? The team likely didn't have compute budget for a full sweep, but the 6× performance gap on those 14 tasks suggests the hybrid VLA+coding-agent approach deserves deeper investigation.
The analogy
Think of a single short-order cook trained on every dish on a 100-item diner menu. Instead of hiring specialists, you train one person longer and more carefully, then bring in a sous-chef with a recipe book for the 14 dishes the cook still can't nail. The cook learns muscle memory (the VLA); the sous-chef reads and plans (the coding agent).
Diner cook
One cook trained on every dish, with a sous-chef handling the hardest 14 by reading recipes and issuing step-by-step instructions
VLA + Astra
One VLA checkpoint trained on all 100 tasks via flow matching, with a GPT-6 coding agent handling 14 hard tasks via observation-conditioned code generation
Honest assessment
This is a strong engineering paper, not a scientific breakthrough. The core contribution is showing that brute-force training scale on a known VLA architecture, combined with a pragmatic hybrid routing to a coding agent, is enough to be competitive on a 100-task benchmark as an independent team. The sim-only validation and absence of sim-to-real transfer keep this firmly in the 'promising demonstration' category rather than 'deployment-ready result.' The Astra routing result (6× improvement on hard tasks) is the most interesting signal — it suggests the field's monolithic-vs-hybrid debate has a clear empirical answer for long-horizon manipulation.
What Is CLAIMS?
63
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
3/5
Ladder
3/5
Architecture
4/5
Integrity
3/5
Milestone
2/5
Successor
4/5
What is this paper actually committing to?
Genuine scale demonstration: one checkpoint, 100 tasks, competitive leaderboard result from an independent team. Not a new architecture, but a first for single-model breadth at this benchmark complexity.
The field fight
Should general-purpose robot policies be monolithic end-to-end VLAs or hybrid systems that route hard tasks to symbolic/code-generation modules?
Side A
Scale the VLA — one model, enough data and compute, and end-to-end learning will cover everything
Held by: Physical Intelligence π₀, Google RT-2, Octo
Side B
Hybrid routing is necessary — code-generation agents handle structured reasoning that VLAs can't learn from demos alone
Held by: SayCan, Code-as-Policies, this paper's Astra routing
Milestone tracker
Unlocks: Credible single-policy household robot that generalizes across real-world task diversity
Current
0.392
Q score
100 sim tasks, this paper
Next
0.7+
Q score
with sim-to-real on ≥5 tasks
~2-4 years, contingent on hardware access and sim-to-real bridging
Verified Facts (7)
Placed 9th on the final leaderboard, the only independent team in the top 10
On the 50 tasks shared with 2025, its Q rises from 0.260 to 0.371; across all 100 tasks it scores 0.392
A 200k-step training run, about one pass over the 211M frames of the demonstrations
Across these 14 tasks, Astra's mean Q is 0.639, against 0.108 for the learned policy
The public submission included only part of the Astra results and scored 0.446 Q with 27.3% full-task success
21-dimensional action space matching the teleoperation controls
Six simulators on one GPU together faster than real time
Practical Implications (4)
For VLA practitioners: training longer on more tasks with warm-started embeddings and variance-reduced flow matching yields large gains without architectural changes — check if your model is simply undertrained before redesigning.
For robotics teams: hybrid routing to a coding agent on tasks where VLA Q < 0.15 can yield 5-6× gains, suggesting a practical deployment pattern for heterogeneous task portfolios.
For competition entrants: cloud eval infrastructure with provenance tracking and restorable simulator states is a reproducibility pattern worth adopting regardless of your architecture.
The 211M-frame, 200k-step training regime is achievable on modest cloud budgets — this is not a big-lab-only result.
More latest news
Read all