Imagine you're giving someone directions to a restaurant. You could hand them a photograph of every intersection along the route — beautiful, detailed, full-color. But a simple top-down map with distances marked would get them there faster and with fewer wrong turns. The photograph contains everything the map does and more, yet the map is the better representation for the task. That's the core mechanism of this paper: visual world models default to generating photorealistic RGB views of unseen states, but RGB is often the wrong format for answering spatial questions about those states. The committed claim: generating accurate RGB images of unobserved viewpoints does not guarantee accurate spatial reasoning, and selecting task-appropriate alternative representations (depth maps, panoramic views, top-down geometry) systematically outperforms RGB-only imagination. This is not about building a better world model — it's about what you do with the world model's output before you reason over it. The authors introduce ImagiRep, a simulator-grounded benchmark of 922 questions across seven question types in two settings: Viewpoint Imagination (reasoning about what you'd see from a different position) and Cross-view Integration (combining information from multiple views). The benchmark is built on top of oracle and estimated representations — meaning the authors can separate 'how good is the imagination?' from 'how good is the representation for reasoning?' That separation is the key methodological contribution. They provide RGB plus six alternative representations of each imagined state, creating a controlled comparison that isolates the representation variable. The ladder is clear but the field is young. The paper compares against SpatialBot, LLaVA-Video, SpatialRGPT, and other recent spatial reasoning systems. The headline result: even with oracle (perfect) RGB, spatial reasoning accuracy is far from ceiling, and swapping in the right alternative representation lifts performance substantially depending on question type. Top-down geometry helps distance comparisons; panoramic views help reasoning about open space. No single representation dominates across all tasks — which is precisely the point. The architecture family here is test-time representation selection, not model training. GEARS (their adaptive strategy) is a lightweight routing mechanism that picks which representation to feed to the reasoning model at inference time, without retraining anything. It sits on top of existing VLMs and world models. Think of it as a representation middleware — the model generates the imagined state, GEARS picks the best lens to view it through, and the VLM reasons over that lens. This is cheap, modular, and composable with any upstream world model. Integrity is solid for a benchmark paper. The simulator grounding (using Habitat/Matterport3D) means ground truth is available, not estimated. The seven question types are structurally diverse and the oracle/estimated split is the right ablation. The main limitation: 922 questions is small by benchmark standards, and the question types were designed by the authors, not drawn from a pre-registered taxonomy. The GEARS selection strategy is evaluated on the same benchmark it was designed for — a separate held-out benchmark or transfer evaluation would strengthen the case. The successor experiment the authors didn't run: training a world model to directly output task-adaptive representations rather than RGB. Right now GEARS selects among pre-computed alternatives. The obvious next step is a world model that generates depth or top-down geometry natively when the downstream task calls for it, skipping the RGB bottleneck entirely. The honest read: this is being saved for the next paper. The current work establishes the diagnostic (RGB is insufficient) and the proof-of-concept (selection helps). End-to-end training is the payoff paper.
