Imagine you're navigating a dark house with a flashlight that only illuminates what's directly in front of you. You can't see where you've been or how far you are from the kitchen. Now imagine you're allowed to leave Post-it notes on the walls as you go — "getting warmer," "dead end" — and read them on your next pass. That's Value as Memory: the robot's own value predictions become breadcrumbs that encode task progress, compensating for the fact that a single camera frame can't tell you whether you're 10% or 90% through folding a shirt. The committed claim: conditioning a generalist robot policy on its own cached value predictions as a form of task-progress memory, combined with online real-world RL that mixes offline demos, human interventions, and autonomous rollouts, produces a 29.4% absolute success-rate gain from value caching alone and 32.8% from online learning — on long-horizon, contact-rich manipulation tasks that defeat standard offline training. The architectural bet is straightforward and clever. VaM sits on top of any diffusion-based or flow-matching generalist policy (the paper uses π₀ as the backbone). A separate value head is trained to predict expected returns; these predictions are cached over recent timesteps and concatenated into the policy's observation vector. This is not a new RL algorithm — it's an observation-augmentation trick that converts a value function from a training signal into an inference-time memory channel. The online RL loop then uses a RLPD-style mixed replay buffer: 50% offline demonstrations, variable fractions of human-corrected interventions, and on-policy autonomous rollouts, with sparse binary rewards (task succeeded or not). The key throughput trick is pipelining data collection and gradient updates concurrently, yielding 8× more policy iterations under a fixed gradient-step budget and 2× lower wall-clock time per gradient step. The evaluation ladder is honest but narrow. VaM is tested on four real-world tasks — shirt folding, towel folding, bag packing, and cup stacking — chosen specifically for deformable objects and contact richness where partial observability bites hardest. The baselines are the offline-trained π₀ policy and ablations (no value caching, no online learning, various replay mixes). What's missing: no comparison to other online post-training frameworks like RoboFuME, RLIF, or MEDAL, nor to explicit state-estimation or recurrent-memory approaches (LSTMs, transformers with history). The improvements are real and the tasks are genuinely hard, but the competitive landscape is incompletely mapped. Integrity is mixed. This is real-robot evaluation with real physical outcomes — no sim-to-real gap to worry about. But the experiments are all run by the same team on the same hardware, with task-specific reward functions they designed. Success is judged by the experimenters. Sample sizes per condition appear modest (the paper reports means across rollout batches but individual task trial counts aren't prominently stated). No pre-registration. Code availability is not confirmed in the abstract. The 29.4% and 32.8% numbers are mean absolute gains across tasks, which could mask variance across individual tasks. The milestone framing is clear: VaM gets generalist policies from ~40-50% to ~70-80% success on hard manipulation tasks with online learning. The next milestone that matters is 95%+ reliability on these tasks, which would make autonomous robot labor economically viable for warehouse and domestic settings. That likely requires scaling the online learning loop to hundreds of tasks simultaneously — a data logistics problem more than an algorithmic one. The honest gap is sim-to-real transfer and multi-embodiment testing: VaM has only been shown on one robot platform with one set of tasks. Whether value caching transfers across morphologies and sensor configurations is the experiment the authors didn't run, most likely because they're saving it for the next paper — the framework is clearly designed to be backbone-agnostic.
