Elastic-WAM Teaches Robots to Daydream Efficiently — Imagining Only What Matters, When It Matters

Adaptive compute allocation for robot world models: skip the irrelevant pixels, stop denoising early when the picture is clear enough, and let the action policy decide what 'enough' means.

Imagine you're driving through a familiar neighborhood. You don't scrutinize every mailbox — you focus on the intersection ahead, the kid on the bike, the car pulling out. Your brain allocates attention spatially (where to look) and temporally (how long to process). Elastic-WAM does the same thing for robot world models: instead of burning equal compute imagining every pixel of every future frame, it learns a "refinement demand field" that tells the system where and when to stop thinking. The committed claim: World-Action Models (WAMs) that imagine future visual states to guide robot actions can be made substantially faster without losing — and sometimes gaining — task success by adaptively allocating denoising compute across space and time. This is not the first paper to accelerate diffusion-based world models, but it is the first to jointly adapt both spatial and temporal refinement budgets using an action-grounded learning signal. Prior work like Diffusion Forcing and related partial-denoising methods use fixed schedules — Elastic-WAM makes the schedule itself learnable and task-dependent. The architecture sits in the diffusion-based video prediction family, specifically building on the World-Action Model (WAM) line where a diffusion model generates predicted future frames and a downstream action head consumes those predictions to output robot control commands. The key structural addition is a "spatiotemporal refinement demand field" parameterized by a shared temporal basis and per-region spatial amplitudes. This field is learned through a three-stage supervised procedure: first train the WAM, then train action prediction on fully-denoised outputs, then distill the demand field by measuring how much denoising each region actually needs before action quality degrades. At inference, this field governs early stopping (temporal), step-size modulation (how far each denoising step jumps), and spatial sparsity (which image regions get refreshed). On the ladder: the paper evaluates across LIBERO, MetaWorld, and RLBench simulation benchmarks plus real-world long-horizon manipulation. It reports state-of-the-art control performance while reducing inference latency compared to both full-denoising WAMs and fixed partial-denoising baselines. The honest comparison is against Diffusion Forcing and standard WAM with uniform denoising schedules. The improvements are real but incremental — this is an efficiency paper, not a capabilities breakthrough. Task success rates are comparable or slightly better; the win is in compute. Integrity is mixed. The benchmarks are established community suites (LIBERO, MetaWorld, RLBench), which is good. Real-world experiments on long-horizon manipulation add credibility beyond pure simulation. However, there's no pre-registration, no code release mentioned in the abstract (project page exists), and validation is entirely by the authoring team. The three-stage training procedure introduces enough hyperparameters that the risk of benchmark-specific tuning is non-trivial. The real-world experiments are the strongest integrity signal — simulation-only would be weaker. The milestone to watch is whether adaptive compute allocation becomes standard in embodied AI world models, specifically whether the "refinement demand field" concept generalizes beyond manipulation to navigation, locomotion, and multi-agent settings. Today's result is on tabletop-scale manipulation; the next unlock is real-time adaptive world models running on edge hardware for mobile robots, which likely requires 3-5× further latency reduction. The obvious experiment not run: scaling to significantly longer horizons (minutes, not seconds) and testing whether the learned demand field transfers across substantially different task distributions without retraining the third stage. The honest read is probably (a) — compute and time constraints. Learning the demand field for each new task family requires the full three-stage pipeline, and showing zero-shot transfer of the refinement schedule itself would be a much harder result. They're likely saving the transferability question for the next paper.