Discrete Waypoints as Steering Signals: AutoVLA-D Shows That Coarse Trajectories Make Better Conditions Than Outputs for Autonomous Driving

A two-stage VLA pipeline uses discrete trajectory tokens not as final predictions but as geometric conditioning, boosting continuous planning across three driving benchmarks. NeurIPS 2026.

Imagine you're giving someone driving directions. You could say "turn left at the light, then straight for two blocks, then slight right" — coarse, discrete, human-readable steps. Or you could read out GPS coordinates at 10 Hz. The first is easier to reason about but too crude to actually steer the car. The second can steer the car but is almost impossible to reason about verbally. AutoVLA-D's insight is: do both. Generate the coarse directions first as a reasoning scaffold, then use them to condition the fine-grained GPS output. The coarse plan is a thinking tool, not the answer. The committed claim: representing trajectory geometry as a discrete 1D-Brohan differential action sequence and injecting it as a conditioning signal — TrajCond — consistently improves continuous trajectory prediction in vision-language-action (VLA) models for autonomous driving. Discrete trajectories are weaker when used as direct outputs, but stronger when used as intermediate conditions. This is a structural finding about representation, not just a benchmark bump. The method works in two stages. First, the VLA model learns to autoregressively generate TrajCond — a discretized trajectory in differential (action-space) form, borrowing from RT-2's Brohan tokenization. Second, TrajCond conditions the final continuous trajectory prediction. The "Double" in AutoVLA-D refers to simultaneous autoregressive generation of both discrete and numeric trajectories. The architecture is autoregressive VLA (transformer-based vision-language-action model), leaning on the tokenization trick that makes geometric trajectory structure legible to the language-modeling head. Evaluation spans three benchmarks: NAVSIM navtest (closed-loop), nuScenes (open-loop), and NeuroNCAP (safety-critical scenarios). The paper's central experimental finding is the asymmetry: discrete trajectories underperform as direct outputs but reliably lift performance when used as TrajCond. This is tested across closed-loop and open-loop settings, which strengthens the structural claim. The benchmarks are community-standard, not bespoke. Code is released on GitHub. The integrity picture is solid for an empirical robotics paper. NAVSIM and nuScenes are established community benchmarks with known leaderboards. The authors compare against relevant VLA baselines and run ablations showing TrajCond's contribution in isolation. The gap is the usual one: no real-world deployment, no independent replication, and the experiments are simulation/replay-based. The NeurIPS 2026 acceptance adds a layer of peer review. The milestone question is about VLA planning closing the loop with real driving. Current VLA planners achieve strong closed-loop simulation scores (NAVSIM PDMS in the 85-90 range for top methods), but the gap to deployment-grade reliability — think 99.9%+ safety margins on diverse real roads — remains large. AutoVLA-D's contribution is architectural: it demonstrates that intermediate discrete representations are load-bearing for continuous planning quality. The next concrete test is whether TrajCond transfers to real-world closed-loop driving with actual sensor noise and distribution shift. The experiment the authors didn't run: scaling TrajCond to longer horizons and harder edge cases, and testing on real vehicles. The honest read is (a) compute and platform access — real-world closed-loop experiments require fleet-scale hardware partnerships — and (c) likely saving real-world transfer for a follow-up. The discretization resolution of TrajCond and its sensitivity to tokenization granularity also go relatively unexplored, which could be a (b) situation if coarser/finer bins hurt performance.