Imagine you're a chess player who can visualize ten possible next moves and see five turns ahead for each one. That's powerful — but only if you can actually tell which of those ten visualized futures is winning. If your evaluation function is broken, all that lookahead is wasted compute. This paper is about exactly that gap, applied to robot action models that generate both actions and visual predictions of what happens next. The core claim: world action models (WAMs) that jointly predict actions and their visual consequences create real planning potential — but current methods for scoring those imagined futures barely tap it. The authors set up an oracle experiment to measure the ceiling. Starting from the same state, they sample multiple candidate actions, execute all of them in the real environment, and pick the one with the best actual outcome. This oracle selection raises task success from 68.9% (random pick among candidates) to 79.2% — a 10.3 percentage point gap that represents the maximum extractable value from better selection. They then test three families of selectors — visual quality metrics, physical consistency checks, and task-progression scores — as controlled interventions to close that gap. The results are sobering. Some selectors yield small gains, but no tested scoring function recovers more than a fraction of the oracle opportunity. The gap between 'we can generate diverse futures' and 'we can recognize which future is good' remains wide open. The architectural setup matters. WAMs belong to the action-conditioned video prediction family — think of them as video generators steered by action tokens. The planning loop is sample-then-score: generate N candidate action-visual pairs from one state, score the visual predictions, pick the highest-scoring action. This is structurally similar to beam search in language models, but the scoring problem is far harder because visual prediction quality and downstream task success are only loosely correlated. The most interesting finding is structural, not numeric. Counterfactual branching from identical states reveals that selection opportunity is concentrated in relatively few decisions — most candidate sets don't contain meaningfully different outcomes. Action diversity and outcome diversity don't scale together. You can sample ten actions that all lead to roughly the same place. The moments where selection actually matters are sparse and hard to identify in advance. Integrity-wise, the same-state analysis is the strongest design choice here. By branching from identical states rather than comparing across trajectories, the authors isolate selection effects from compounding errors — a common confounder in planning evaluations. The weakness is that all evaluation runs in simulation, and the connection between visual prediction quality metrics and real-world task success remains unvalidated on physical hardware. The practical upshot for robotics researchers: stop optimizing WAMs purely for visual fidelity. A model that generates beautiful but indistinguishable futures is less useful than one that generates ugly but decision-relevant futures. The field needs scoring functions that track task-relevant divergence, not pixel-level quality. The milestone isn't a specific accuracy number — it's the existence of a selector that closes even half the oracle gap reliably across tasks.
