New Benchmark Exposes a Blind Spot in Video World Models: They Can't Remember Where They've Been

WanderBench tests whether video generation models can explore a recorded scene and keep it consistent on revisit. None can. WanderLand offers a training-free patch worth up to 8.3 points.

Imagine you're giving someone a virtual tour of your apartment via video call. You walk them through the kitchen, into the living room, then circle back to the kitchen. They expect the kitchen to look the same — dishes in the sink, light through the window, the cat on the counter. Now imagine the video call is being hallucinated by an AI that saw the original footage once. Current video world models are that AI, and they fail the kitchen test every time. The committed claim: no existing benchmark tests whether video-conditioned world models preserve identity, event progression, and scene consistency when a virtual camera revisits a location. WanderBench is the first to do so, evaluating six dimensions across 24 human-validated sub-metrics on 745 source videos with explicit keyboard-driven camera routes. The result is a structured indictment — as source clips grow longer (3 to 25 seconds), models maintain static scene quality and visual fidelity but progressively lose camera control and, critically, the dynamic elements (moving subjects, evolving events) that made the source video a living scene rather than a backdrop. Eight models were benchmarked across three difficulty tiers. The finding that cuts deepest: none of the eight keeps revisited locations consistent. This isn't a marginal failure on an edge case — it's a category gap. The models are generating plausible-looking video, but they are not maintaining an internal world state. They're painting new frames, not navigating a remembered space. This distinction matters enormously for downstream applications like free-viewpoint replay, re-shooting footage, or building real-to-sim environments for embodied agents, all of which require the world to be a persistent object rather than a sequence of pretty hallucinations. WanderLand, the proposed remedy, is refreshingly modest. It's a training-free framework that conditions each generated frame on the corresponding instant from the source video and, upon revisits, on the model's own earlier static-scene output. No new parameters, no fine-tuning. Applied to five existing models, WanderLand improved every evaluation dimension, with source-dynamics fidelity gaining up to 8.3 points. The mechanism is essentially external memory injection — the model is reminded of what it should be seeing rather than asked to recall it from latent state. The validation regime is solid for a benchmark paper: human-validated sub-metrics, three difficulty tiers preventing cherry-picking on easy clips, and evaluation across eight named models rather than a single favorable comparison. The 745-video dataset mixing real and AI-generated content gives breadth, though the keyboard-action camera specification is a simplification that avoids the harder problem of continuous trajectory control. The ladder here is less about beating a prior SOTA and more about establishing the measurement itself — previous benchmarks (single-image or text-prompted, scored on perceptual quality and camera following) were measuring the wrong things for this use case. The milestone question is concrete: current models score zero on revisit consistency. The first model to achieve non-trivial revisit fidelity — say, preserving 60%+ of dynamic elements on a 15-second loop-back — would represent a qualitative jump. WanderLand's 8.3-point improvement on source dynamics shows the gap is addressable without retraining, but the revisit consistency problem likely requires architectural changes: persistent scene representations, explicit world-state tracking, or memory-augmented generation. The gap between 'pretty video' and 'explorable world' is the gap between frame prediction and world modeling, and this paper gives the field a ruler to measure it. The obvious experiment not run: testing WanderLand on models with explicit 3D scene representations (e.g., NeRF-conditioned generators or Gaussian-splatting-based approaches) rather than purely 2D video diffusion models. The honest read is (a) — the five models tested are all from the dominant video-diffusion paradigm, and bridging to 3D-aware architectures would be a different paper with different infrastructure. But that's exactly where the revisit-consistency problem might be solvable, and the authors know it.