One Latent Frame to Rule Them All: MetaWAM Packs Robot Signals into Frequency Bands a Video Model Already Understands

Instead of burning extra latent frames on each robot signal, MetaWAM folds proprioception, actions, and values into frequency-domain channels of a single frame — cutting inference latency 39% while hitting 68.9% success on RoboCasa.

Imagine you're packing a suitcase that was designed for clothes. You could throw in your laptop, charger, and toiletries loose — they'd fit, but the zipper would fight you because the compartments expect soft, foldable things. Or you could wrap each rigid item in a T-shirt so it matches the shape the suitcase was built for. MetaWAM does exactly this: it wraps robot signals in a frequency-domain encoding that looks like the video frames a pretrained video diffusion model already knows how to handle, so the model's denoiser barely notices non-video data was injected. The committed claim: you can fold all robot signals — proprioception, actions, value estimates — into a single latent "meta-frame" using disjoint DCT frequency bands, achieving better task success than methods that dedicate a separate latent frame per signal, while cutting inference cost by 39%. This is not a new architecture or a new training objective. It is a representation-alignment insight: the right encoding makes the pretrained prior do more of the work for you. The diagnostic that motivates everything is a "relative reconstruction error" probe. The authors freeze a pretrained video diffusion model's denoiser and measure how much it corrects different encodings of the same robot signal. Conventional spatial encodings — the kind most World Action Model papers use — get heavily corrected, meaning they sit far from the prior the denoiser learned on natural video. Frequency-domain (DCT) packings get corrected far less. This is the paper's load-bearing empirical result: it turns an interface-design question into a measurable distribution-alignment problem. The architecture family is video diffusion with frozen backbone (specifically built atop models like Open-Sora), no new modules added. Each robot variable gets a fixed frequency band within the DCT spectrum of a single latent frame. An inverse DCT lifts everything to spatial-domain latent space. Slot-aware routing lets the same meta-frame support policy prediction, world modeling, and value prediction simultaneously. The key compute property: because you collapse N signal frames into 1, the diffusion model processes fewer tokens per step — hence the latency win. On the RoboCasa benchmark (simulation, 25 kitchen tasks), MetaWAM hits 68.9% average success rate, outperforming HPT (51.8%), Octo (46.1%), and the spatial-encoding WAM baseline GR00T N1 (59.5%). The 39% latency reduction is measured against multi-frame WAM baselines that use separate latent frames per signal. On three real-world Franka manipulation tasks, MetaWAM reaches 85.0% success. The real-world validation is limited to three tasks — a narrow but non-trivial transfer. The integrity picture is mixed. RoboCasa is a community benchmark, which is good. But the real-world evaluation covers only three tasks with no independent replication. Code and models are released, which invites reproduction. The baselines are current (HPT, Octo, GR00T N1) — not stale. The main concern is that the frequency-band allocation is hand-designed and fixed; the paper does not report sensitivity to band assignment choices, which leaves room for a quiet cherry-pick. The obvious next experiment is scaling MetaWAM to harder, longer-horizon manipulation tasks — multi-step assembly, tool use, dexterous bimanual work — and testing whether the fixed DCT band layout remains optimal as the number of robot signals grows. The authors likely didn't run this because RoboCasa's kitchen tasks are already the standard WAM benchmark, and harder tasks would require substantially more real-world infrastructure. Expect this in the follow-up paper. The deeper question the field will need to answer: does frequency-domain packing generalize to other pretrained backbones (e.g., flow-matching models, autoregressive video models), or is this specific to diffusion denoisers?