Raw Radar Spectra Beat Every Handcrafted Pipeline When You Teach the Network What 'Signal' Means

Self-supervised masked modeling on raw radar cubes outperforms all existing radar 3D detectors. The trick: let the network define signal vs. noise instead of hand-engineering the split.

Imagine you're restoring a water-damaged photograph. The standard approach is to first decide which parts are damage and which are original — you'd trace the stains, mask them, then inpaint. But what if your assumptions about what counts as 'damage' are wrong? You'd erase faint but real details along with the water marks. This paper argues that radar perception has been doing exactly that: deciding upfront what's signal and what's noise, then throwing away everything that doesn't fit. The authors propose flipping the script — let a self-supervised model learn the distinction by trying to reconstruct corrupted patches, and whatever survives reconstruction is signal by definition. The committed claim: raw radar spectra — the dense, noisy, 4D cubes that the entire field treats as too messy for direct learning — are actually a superior input representation for 3D object detection when paired with the right pretraining objective. No handcrafted CFAR filtering, no sparse point cloud extraction, no compact Doppler descriptors. Just the raw cube and a masked autoencoder. The method is Leakage-aware Spectral MAE (LS-MAE). It belongs to the masked autoencoder family (MAE/BEiT lineage) adapted for radar. The key architectural insight is twofold. First, the corruption strategy mimics spectral leakage — cross-bin energy spreading that's a known physical artifact of windowed FFTs in radar — so the masking is physically motivated rather than random patch dropout. Second, and arguably more important, they reorganize the 4D radar cube into an x-y-Doppler spatial representation with height encoded as features, rather than naively stacking Doppler bins as channels. This Doppler-as-spatial-dimension choice is load-bearing: it lets standard 3D convolutions and transformer blocks operate over the structure that actually matters for detection. On the View-of-Delft (VoD) dataset, LS-MAE pretrained models outperform the prior best radar-only 3D detector across car, pedestrian, and cyclist categories. The paper is unusually thorough with 18 tables of ablations covering masking ratio, corruption strategy, backbone choice, representation format, and pretraining objective comparisons. They compare against both supervised radar baselines (SMURF, RTNH, RadarPillarNet) and self-supervised point cloud methods (ALSO, GD-MAE, Voxel-MAE) adapted to radar. The margin over the best prior radar SSL method is meaningful — not a rounding error. The integrity picture is solid for a perception paper. VoD is a public community benchmark with standard splits. They compare against current baselines rather than stale ones. The ablation depth is genuinely impressive — you can trace which design decision contributes what. The main limitation is single-dataset evaluation: VoD is relatively small and single-sensor-configuration. No nuScenes radar, no in-house proprietary data from the Bosch affiliations that several authors carry. The paper acknowledges this implicitly by focusing entirely on VoD. The milestone to watch is generalization to larger-scale multi-sensor radar datasets and real-time inference. The paper demonstrates that raw spectra work; it hasn't yet shown this at the scale or latency that automotive deployment requires. The 4D radar cube is massive compared to a point cloud, and the computational overhead of processing it end-to-end without reduction is the elephant in the deployment room. If someone demonstrates LS-MAE-style pretraining at nuScenes scale with real-time inference on automotive-grade hardware, the entire radar preprocessing pipeline used in production ADAS systems becomes questionable. The experiment they didn't run — and the gap is conspicuous — is sensor fusion. Every production autonomous driving stack fuses radar with camera and/or lidar. Showing that raw-spectra radar improves a fusion pipeline would be the killer result. My read: they're saving it for the next paper. The single-modality result is already a strong standalone contribution, and fusion introduces confounds that would muddy the clean narrative. NeurIPS 2026 acceptance confirms the reviewers agreed.