A Neural Network That Learns When to Ask Its Teacher: 700× Speedup for Time-Optimal Control on Real Hardware

Self-informed sampling cuts MPC imitation data needs by half and training time by two-thirds, then runs a Furuta pendulum at 1 kHz instead of 1.4 Hz — on actual hardware.

Imagine you're cramming for an exam with access to a genius tutor who takes 45 minutes to answer each question. You can't afford to ask about everything, so you study on your own first, then bring only the problems where your answers diverge from what the tutor would say. That's the core mechanism here: a neural network that learns to imitate an expensive optimal controller, but intelligently picks which states to ask the expert about — saving both the tutor's time and your own. The committed claim: a neural network can imitate a long-horizon, nonconvex time-optimal model predictive controller (TOMPC) with hard terminal constraints, matching its region of attraction while running roughly 700× faster — and this works on physical hardware, not just in simulation. The key enabler is self-informed sampling (SIFS), which uses a learned time-to-go estimator to identify states where the student policy is likely suboptimal, then queries the expensive expert solver only at those states. The result is that SIFS matches the performance of standard DAgger-style dataset aggregation with less than half the data and a third of the training wall-clock time. The TOMPC being imitated is genuinely hard to solve: a long-horizon nonconvex optimization with hard terminal constraints that runs at only 1.4 Hz on the target platform. That's far too slow for the Furuta pendulum, which needs millisecond-scale control. The neural imitator pushes this to 1 kHz — fast enough for real-time swing-up and stabilization. The architecture wraps a standard feedforward neural network inside a complete deployment pipeline that addresses dataset correlation (via DAgger-style aggregation), suboptimal expert labels (the solver sometimes returns local optima), covariate shift (the student drifts off the expert's trajectory distribution), constraint satisfaction (safety layers), and model mismatch (sim-to-real gap). The ladder position is honest but limited. The baseline is the authors' own TOMPC solver — they demonstrate the neural controller matches the expert's region of attraction and trajectory quality. But there's no comparison to other neural MPC imitation methods (e.g., differentiable MPC, diffusion-policy approaches) or to other real-time approximate MPC techniques. The 1.4 Hz → 1 kHz speedup is the headline, and it's real, but we don't know how SIFS compares to, say, active-learning variants from the imitation-learning literature beyond standard DAgger. Integrity is the paper's strongest suit. This isn't another simulation-only demo: the Furuta pendulum is a real underactuated mechanical system with real friction, backlash, and sensor noise. The controller swings up and stabilizes the pendulum on hardware, and the trajectories closely match the expert's solution. The validation stack is layered: simulation training, simulation evaluation of region of attraction, then hardware deployment. The main caveat is that the Furuta pendulum, while a legitimate nonlinear control benchmark, is a relatively low-dimensional system (4 states, 1 input). The hard question — whether SIFS and this architecture scale to higher-dimensional systems with richer constraint structures — is left open. The milestone to watch is dimensionality. The Furuta pendulum is 4-dimensional state space. Real industrial applications — robotic arms, autonomous vehicles, quadrotors — involve 6-12+ state dimensions with multiple inputs and more complex constraint geometries. If SIFS maintains its 2-3× data efficiency advantage at 10+ state dimensions with multi-input systems, that's the result that moves this from a nice conference paper to a deployable methodology. The authors are clearly positioned to test this on a quadrotor or robotic manipulator next. The obvious experiment not run is a higher-dimensional system, and the honest read is (a) — they ran out of time for the conference submission. The Furuta pendulum is the right first proof-of-concept, and the ECC 2027 deadline likely dictated scope. A secondary gap: they don't benchmark SIFS against other active-learning or curriculum-learning strategies from the broader imitation-learning literature, which would strengthen the claim that the time-to-go heuristic specifically is the right query criterion.