A New Group-Theoretic Trick Lets Robots Calibrate Space and Time in One Shot — No Continuous-Time Trajectory Needed

Spatiotemporal sensor calibration unified via the Galilean group, eliminating separate time-offset hacks. Comparable accuracy, cleaner math.

Imagine you're syncing a drum machine to a guitarist who keeps shifting tempo. The standard fix: record the guitarist's exact timing curve, then slide the drum track until the beats align. It works, but you need that entire timing curve — a continuous representation of when every note lands. This paper asks: what if you could encode the tempo drift directly into the coordinate system itself, so the alignment falls out of the math for free? That's the core move here. Multi-sensor robots — think a drone with cameras, IMUs, and range sensors all bolted on at slightly different positions and running on slightly different clocks — need to know exactly where each sensor is (spatial calibration) and exactly when each sensor's timestamps map to the robot's own clock (temporal calibration). The standard pipeline treats these as two separate problems glued together: a rigid-body transformation for space, plus a scalar time offset handled by interpolating or resampling the robot's trajectory. Goudar, Kelly, and Barfoot argue this separation is both inelegant and unnecessary. Their key insight is algebraic. The robot's motion lives naturally on the special Galilean group, SGal(3) — the symmetry group of non-relativistic spacetime that couples rotation, translation, velocity, and time into a single matrix structure. Sensor extrinsics, meanwhile, live on what the authors call the Aristotelian subgroup — the subset that handles spatial offset plus temporal offset without an independent velocity component. By formulating the entire estimation problem on these groups, the temporal offset doesn't require a separate continuous-time trajectory representation. It's absorbed into the group action itself. The trajectory remains a discrete sequence of poses, but the calibration parameters naturally account for the fact that a sensor with a clock offset is effectively sampling the trajectory at shifted times. The paper develops two motion priors within this framework: a twist-driven prior (constant body-frame velocity between timesteps) and an IMU-driven prior (preintegrated accelerometer and gyroscope measurements). Both accommodate non-ideal clocks — where the offset isn't just a fixed shift but drifts over time — by augmenting the state with clock-model parameters. Measurement models are derived for three sensor types: cameras (bearing observations of landmarks), position sensors, and range sensors. Validation spans simulation and real data. In simulation, the authors test camera-IMU, position-IMU, and range-IMU configurations, estimating spatial extrinsics (rotation and translation), temporal offset, and full trajectories simultaneously. They compare against a continuous-time Gaussian-process trajectory approach and report comparable calibration accuracy and trajectory errors. The real-world experiment uses a camera-IMU setup on a handheld rig. Results are again comparable to the continuous-time baseline, which is the honest finding: this is not a performance leap but an equivalent result achieved with simpler machinery. The framework's value proposition is clarity, not accuracy. By encoding the coupling between motion and time offset in the group structure rather than in a separate interpolation layer, the formulation is more compact, avoids the need to choose knot spacing or kernel parameters for a continuous-time trajectory, and makes the relationship between spatial and temporal calibration parameters mathematically transparent. The authors are refreshingly direct about this: they call it a 'quality-of-life improvement,' not a breakthrough. The honest limitation is scope. All experiments involve relatively short trajectories with smooth motion profiles — exactly the regime where discrete-time representations and continuous-time representations should converge. The test of this framework's real advantage would be scenarios where continuous-time methods struggle: very sparse or bursty sensor data, high-rate dynamics, or online calibration during deployment. Those experiments aren't here yet.