
CADENCE SUCCEEDED
+85.1%
FIVE SEEDS AGAINST
+67.8%
OCS2-TROT
+65.5%
OCS2-SINGLE
+39.6%
Imagine you're crossing a stream on stepping stones. Nobody told you to alternate feet in a fixed rhythm — you look at the stones, pick the best next step, and go. Sometimes you pause on one foot, sometimes you rush two quick steps. The pattern emerges from the terrain, not from a metronome in your head. That's what CADENCE does for a quadruped robot: it throws away the metronome entirely and lets the stepping pattern emerge from what the ground offers. The committed claim: a reinforcement-learning policy with a tiny discrete action space (at most 65 choices per tick) can replace hand-designed cyclic gait schedules for model-based quadruped locomotion, discovering acyclic gaits that outperform fixed trot and crawl gaits on rough terrain — without any gait reward term. The only structural prior is that at most two legs swing simultaneously. Everything else — which leg moves, when, how long the swing takes — the policy figures out. The architecture is clean and legible. CADENCE sits on top of a convex model predictive controller (MPC) that handles the continuous dynamics. Every 40 milliseconds, the learned policy picks one discrete action: do nothing, or command one of four legs to step to a specific safe foothold from a precomputed set, plus a predicted swing time. The action space stays small because the footholds are precomputed from terrain data, not learned. Training is standard RL against the convex MPC; the reward penalizes per-step cost, not gait style. An inverse footstep model (IFM) translates footholds into velocity commands the MPC understands. Critically, the IFM can be refitted to a different MPC backend — the authors demonstrate this by running the frozen CADENCE policy on OCS2's nonlinear MPC after refitting the IFM on fewer than 20,000 logged steps. The ladder is straightforward. On simulated terrain with 26–49% void coverage at 0.1 and 0.2 m/s, CADENCE achieves an 85.1% mean success rate across five seeds, versus 67.8% for OCS2-Trot and 65.5% for OCS2-Single (a crawl gait). At the hardest terrain setting (49% voids), the gap widens: 72.9% vs 43.0% for OCS2-Trot. A static-walk ablation of CADENCE — removing the learned step planner — collapses to 39.6%, confirming the policy is load-bearing. These are simulation numbers on procedurally generated terrain; no hardware experiments are reported. Integrity is simulation-only, which is the main caveat. The baselines (OCS2-Trot, OCS2-Single) are reasonable choices — OCS2 is a widely used MPC framework in the legged robotics community — but stronger learned-locomotion baselines from the sim-to-real RL literature (DreamWalker, AnymalRL-style end-to-end policies) are absent. The five-seed protocol is good practice for RL variance, and the terrain generation parameters are specified. But the validation loop is entirely within the authors' own simulation pipeline. No code release is mentioned. What's genuinely interesting is the emergent gait structure. The policy, given no gait schedule and no periodicity reward, independently converges on diagonal-leg pairing — the same coordination pattern that biological quadrupeds and hand-tuned trot gaits use. But it does so acyclically: the period and stepping order vary with terrain. This is a small but real contribution to the question of whether gait structure needs to be prescribed or whether it falls out of optimization against terrain constraints. The obvious next experiment is hardware deployment. The IFM refitting to OCS2's nonlinear MPC is a step toward transfer, but the sim-to-real gap for footstep planning on rough terrain is notoriously large — perception noise, foot slippage, and terrain estimation errors all compound. The authors likely know this and are either working toward it (saving it for the next paper) or found that perception-stack integration is the bottleneck. The 20,000-step IFM refitting budget is suspiciously convenient for a sim-to-sim transfer; whether that budget holds for real hardware is the key question.
The analogy
You're crossing a stream on stepping stones. A fixed gait is like marching to a metronome — left-right-left-right regardless of where the stones are. CADENCE is like how you actually cross: scan the stones, pick the best next step for whichever foot, go. The rhythm emerges from the terrain, not from a timer.
Stream crossing
Pick the next safe stone for whichever foot is free, adapting rhythm to stone placement
CADENCE planner
Pick the next safe foothold for whichever leg is free every 40ms, adapting gait to terrain voids
Honest assessment
CADENCE is a clean, well-scoped contribution to the hybrid learned/model-based locomotion stack: discrete RL step selection atop classical MPC, with emergent acyclic gaits that beat fixed gaits by a wide margin in simulation. The integrity gap is simulation-only validation without code release or comparison to the strongest end-to-end learned baselines. This is a solid methods paper aimed at the next paper — the hardware demo — rather than a standalone result. Robotics researchers working on model-based locomotion should read it; practitioners waiting for deployable rough-terrain solutions should watch for the follow-up.
What Is CLAIMS?
63
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
3/5
Ladder
3/5
Architecture
4/5
Integrity
2/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Real but incremental. Acyclic gait emergence from RL+MPC is a clean result, but learned step planners on top of MPC are an active area — this is a well-executed iteration, not a first-of-kind.
The field fight
Should quadruped locomotion on rough terrain be solved by learned end-to-end policies or by learned components on top of model-based control?
Side A
End-to-end RL with sim-to-real transfer; the MPC is unnecessary overhead
Held by: ETH Zurich ANYmal RL, Lee et al., Miki et al.
Side B
Keep the MPC for dynamics, learn only the high-level decisions; modularity aids transfer and interpretability
Held by: CADENCE (this paper), Grandia et al., Jenelten et al.
Milestone tracker
Unlocks: Acyclic gait planners deployable on real rough-terrain quadrupeds without hand-tuned gait schedules
Current
85.1%
sim success
CADENCE (sim, 26-49% voids)
Next
>70%
hardware success
Real terrain with perception noise
~1-2 years if perception stack and IFM transfer hold on hardware
Verified Facts (7)
Every 40 ms, it picks one of at most 65 discrete choices: no step, or one leg's step to a safe foothold
At most two legs may swing at once
CADENCE succeeded in 85.1% (mean of five seeds), against 67.8% for OCS2-Trot, 65.5% for OCS2-Single, and 39.6% in a static walk ablation
At 49% voids, it succeeded in 72.9%, against 43.0% for OCS2-Trot
IFM refitted on fewer than 20,000 steps
Terrains ranged from 26% to 49% voids, speeds 0.1 m/s and 0.2 m/s
The policy developed an acyclic gait, with no fixed period or stepping order, yet it still paired diagonal legs
Practical Implications (3)
Discrete step-selection RL with ≤65 actions is trainable and stable — practitioners can try this action-space design for other hierarchical robot planning problems
IFM refitting in <20K steps enables swapping the MPC backend without retraining the policy, reducing integration cost for teams already using OCS2 or similar frameworks
Acyclic gaits from optimization-only reward (no gait term) suggests hand-tuned gait schedules may be unnecessary overhead in rough-terrain quadruped control
More latest news
Read all