LaST0.5 Adds a 'Translator' Layer Between Robot Vision and Robot Action — and It Actually Helps

A new World Action Model inserts an interaction-focused reasoning layer between scene prediction and motor commands, hitting 99.5% on LIBERO and new SOTA on RLBench. 14k hours of pretraining data.

Imagine you're watching a cooking show on mute. You can see the whole kitchen — countertops, ingredients, the chef moving around. You understand the scene evolving over time. But if someone asks you to replicate a specific knife cut, the wide-angle view isn't enough. You need to zoom into the contact point: how the blade meets the carrot, the angle of the wrist, the pressure. That's the core insight behind LaST0.5: global scene understanding is necessary but insufficient for manipulation. You need a dedicated representation of the interaction zone. The committed claim: LaST0.5 is the first World Action Model to insert an explicit interaction-centric latent space between world modeling (predicting what the scene will look like next) and action generation (deciding what the robot should do). Prior WAMs — whether they predict video first and then extract actions, or jointly model both — pass global scene representations straight to the action head. LaST0.5 argues this creates a representational mismatch: what's good for predicting how the whole scene evolves isn't the same as what's good for deciding how to grasp a cup. Architecturally, this is a Mixture-of-Transformers with three expert pathways: a world expert (scene evolution), an interaction expert (robot-object contact dynamics), and an action expert (motor commands). The interaction expert is the new piece — a latent space supervised by visual interaction cues extracted from robot-environment contact regions. It acts as a bottleneck translator, forcing the model to compress global scene knowledge into interaction-relevant features before those features reach the action decoder. The system also predicts 'progress values' — essentially a self-assessed confidence about task completion — which it uses to decide when to resample future predictions rather than blindly executing stale plans. The numbers are genuinely strong. On LIBERO, the standard multi-task manipulation benchmark, LaST0.5 hits 99.5% average success rate. On RLBench, it surpasses previous state of the art across ten evaluated tasks. The authors also demonstrate real-world performance on long-horizon tasks and dexterous manipulation, though the real-world evaluation is necessarily less controlled. Pretraining used over 14,000 hours of robotic data — a serious corpus that places this in the scaling-era camp of robot learning. The integrity picture is mixed. LIBERO and RLBench are community-standard benchmarks, which is good — but the paper evaluates on ten selected RLBench tasks rather than the full suite, and it's not clear whether task selection was pre-committed. The real-world experiments demonstrate capability but lack the controlled conditions of simulation benchmarks. No code release is mentioned in the abstract. The comparison against prior WAMs is direct and named, but the field is moving fast enough that baselines can become stale within months. The milestone question for this line of work is clear: can interaction-centric representations scale to truly complex, contact-rich manipulation — think assembly, tool use, deformable objects — and do so zero-shot in novel environments? LaST0.5 demonstrates the principle at the current task complexity frontier, but the real test is whether this architectural bet pays off as task difficulty increases. The authors did not run ablations removing the interaction expert and replacing it with a naive concatenation of world features and action features at the same parameter count — the experiment that would prove the architectural choice matters independent of model size. That's either being saved for a follow-up or didn't produce a clean enough story. This paper matters because the WAM paradigm is one of the two or three most active fronts in robot learning right now, and the question of what intermediate representation should sit between perception and action is genuinely unresolved. LaST0.5's bet on interaction-centric latents is architecturally clean, empirically strong, and — if the approach generalizes — could become the default design pattern for the next generation of manipulation policies.