Imagine you learned to ride a bike on smooth pavement, and now you're on gravel. You don't need a coach yelling scores at you — you have an internal sense of balance, and you shift your weight based on which moments feel most unstable. That's the core mechanism here: a pretrained critic network serves as the robot's internal balance sense, and the policy adjusts itself by focusing on the moments that feel worst. The committed claim: TEMPO is a test-time adaptation method for RL locomotion policies that works on-device, requires no reward signal at deployment, and stabilizes adaptation under severe distribution shift using entropy regularization and a score-based memory buffer. It is not the first paper to propose test-time adaptation for robot control — the frozen-critic baseline it builds on is itself a contribution of this paper — but it is the first to combine critic-driven updates with both entropy-regularized overconfidence mitigation and prioritized replay of hard observations, validated on physical hardware. The architecture sits in the actor-critic family, specifically exploiting the asymmetry between actor and critic at deployment. The actor is the only thing updated; the critic stays frozen and acts as a surrogate reward. The two novel components are an entropy-promoting regularizer on the critic's predictive distribution — preventing the critic from becoming overconfident on out-of-distribution states — and a score-based memory that preferentially replays low-value (difficult) observations with importance-sampling corrections. This is lightweight by design: the entire adaptation loop runs on-device with no external compute, no reward oracle, no human in the loop. On the ladder, the paper benchmarks across Unitree Go1, Go2, and G1 robots in MuJoCo Playground under four shift types: rough terrain, slippery surfaces, payload changes, and sensing degradation. The frozen-critic baseline (which the authors themselves introduce) already improves over no adaptation; TEMPO then stacks gains on top, reaching up to 80% improvement over the non-adapted baseline in the single-device setting. Multiple architectures are tested. The paper is honest that the frozen-critic baseline is itself a strong competitor and that TEMPO's advantage is most pronounced under severe shift. Real-world validation uses a Unitree Go2 with an added calf payload — not a huge battery of physical experiments, but a meaningful existence proof. Integrity is mixed in the way typical of robotics RL papers. Simulation results use MuJoCo Playground, a community simulator, which is good. But the benchmarks are defined by the authors (four shift types), not drawn from a pre-existing community challenge suite. The real-robot experiment is small — enough to show the method works on hardware, not enough to characterize failure modes. No pre-registration. Code availability is not explicitly stated in the abstract. The NeurIPS 2026 acceptance is a strong peer-review signal. The milestone question is about closing the gap between sim adaptation and robust real-world deployment. Right now we have up to 80% improvement in sim and a single real-robot scenario. The next number to watch: consistent adaptation across 10+ distinct real-world shift types on diverse hardware, running continuously for hours without degradation. That's probably 2-3 years out, dependent on both algorithmic maturity and edge-compute improvements. The obvious experiment not run: long-horizon deployment where the critic's frozen quality degrades as the policy drifts further from its training distribution over many adaptation cycles. The frozen critic is a snapshot of training-time value estimates; after enough adaptation steps, the actor may have moved far enough that the critic's guidance becomes stale or misleading. My read: they likely observed some version of this in early experiments and scoped the paper to shorter adaptation horizons where the frozen critic remains reliable. This is the natural follow-up — and the one that determines whether TEMPO is a deployment tool or a research demo.
