
Imagine you record a friend singing a song at 44.1 kHz, then downsample to 22 kHz. The melody is still there — you haven't lost any audible information because human hearing tops out well below 22 kHz. Now imagine your audio transcription model falls apart anyway, not because the signal degraded but because it memorized what 44.1 kHz 'looks like' in raw samples. That's the core problem this paper exposes for time-series foundation models applied to sensor data. The committed claim: this is the first systematic evaluation of whether TSFMs (MOMENT, Chronos-2, Moirai-MoE, TimesFM) are invariant to sampling frequency changes in sensor data, as opposed to merely being accurate at the frequency they were trained on. The authors introduce three novel metrics — FSI (embedding shift), FDI (forecasting degradation), and CDI (downstream classification degradation) — to separate the model's sensitivity to frequency value from the actual information loss caused by undersampling. This is a diagnostic paper, not a methods paper: it doesn't propose a fix, but it precisely measures a failure mode nobody had formally quantified. The ladder position is genuinely first-of-kind for this specific question. Prior TSFM evaluations (Montsquare benchmark, Forecastpfn, etc.) treat sampling frequency as a fixed property of each dataset, never varying it within an evaluation. Classical signal processing has Nyquist theory for when information is lost, but nobody had asked: do TSFMs degrade in line with Nyquist limits, or do they degrade earlier and for non-physical reasons? The answer, across all four models, is the latter — models lose performance even when the downsampled signal retains all task-relevant bandwidth. Architecturally, the paper treats the four TSFMs as black boxes from distinct families: MOMENT (masked autoencoder, patch-based), Chronos-2 (tokenized quantile forecaster, T5-based), Moirai-MoE (mixture-of-experts, universal forecaster), and TimesFM (decoder-only, patched). The stress-test pipeline resamples input signals at controlled rates, computes Nyquist margins, and measures output divergence. The compute property being exploited is simple: resampling is cheap, so you can generate a dense grid of (signal, frequency) pairs and measure degradation curves rather than single-point benchmarks. The integrity profile is solid for a diagnostic study but has clear limits. The authors evaluate on real sensor datasets (accelerometer, physiological signals) rather than synthetic data, which is good. But the evaluation is entirely within-team: no independent replication, no pre-registration, and the three proposed metrics (FSI, FDI, CDI) are novel and unvalidated by external use. The choice of only four TSFMs is defensible (they're the most prominent) but the absence of a classical signal-processing baseline (e.g., a simple Butterworth-filtered feature extractor) as a control condition is a missed opportunity. The milestone question is where this paper is most honest and most limited. It characterizes the problem but doesn't propose a threshold for 'acceptable SF-invariance' or a concrete target number a future model should hit. The implicit next milestone is a TSFM whose degradation curve tracks the Nyquist information-loss curve within some epsilon — but the paper doesn't specify that epsilon or estimate how far current models are from it in absolute terms. The obvious successor experiment: fine-tune or retrain one of these TSFMs with frequency-augmented data (random resampling during training) and measure whether the invariance gap closes. The authors almost certainly know this is the next step. My read: they're saving it for a follow-up paper, because the diagnostic framing is cleaner as a standalone contribution and the fix is a separate research question with its own complexity.
The analogy
You record a song at 44.1 kHz and downsample to 22 kHz. The melody is intact — no audible information lost. But your audio transcription model falls apart anyway, because it memorized what 44.1 kHz waveforms 'look like' instead of learning the music. That's what these foundation models do with sensor data at different sampling rates.
Audio downsample
Reducing sample rate of a recording while keeping all audible frequencies intact per Nyquist
Sensor resampling
Reducing sampling frequency of sensor data while retaining all task-relevant bandwidth per Nyquist
Honest assessment
This is a well-framed diagnostic paper that asks a question the TSFM community has been quietly ignoring: do these models actually understand temporal structure, or are they memorizing sampling-rate-specific patterns? The answer — they're memorizing — is important but not surprising to anyone with signal processing intuition. The contribution is making it measurable with three concrete metrics, not solving it. Worth reading if you deploy TSFMs on sensor data with variable sampling rates; less urgent if you work in fixed-frequency domains.
What Is CLAIMS?
60
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
3/5
Integrity
3/5
Milestone
2/5
Successor
3/5
What is this paper actually committing to?
Genuine first: nobody had formally measured SF-invariance of TSFMs. Three novel metrics (FSI, FDI, CDI) separate model fragility from actual information loss. Diagnostic, not solution — but the question needed asking.
The field fight
Are time-series foundation models learning generalizable temporal representations, or memorizing distributional patterns of their training data?
Side A
TSFMs generalize across domains and conditions; scale and pretraining data diversity handle distribution shifts
Held by: TimesFM (Google), Chronos (Amazon), foundation model scaling advocates
Side B
TSFMs are brittle to distribution shifts not seen in training; robustness must be explicitly evaluated and engineered
Held by: OOD robustness community, this paper, classical signal processing practitioners
Milestone tracker
Unlocks: Reliable deployment of TSFMs across sensors with variable sampling rates without per-frequency recalibration
Current
4
TSFMs characterized
this paper
Next
ε-bound
Nyquist tracking tolerance
SF-invariant TSFM
~1-2 years; requires frequency-augmented training + broader model coverage
Verified Facts (6)
4 TSFMs tested: MOMENT, Chronos-2, Moirai-MoE, and TimesFM
3 dimensions probed: shift in embeddings, degradation in forecasting performance, degradation in downstream performance
3 novel metrics introduced: FSI, FDI, and CDI
Authors state: 'first study to place SF-invariance at the core of TSFM evaluations'
Authors: Sourish Gunesh Dhekane, Abinaya Kumar, Torsten Woertwein, Yan-Bo Lin, Thomas Ploetz, Shabnam Ghaffarzadegan
Categories: cs.LG, cs.AI
Practical Implications (4)
If you deploy TSFMs on sensor data where sampling rate varies across devices or power modes, expect silent accuracy degradation that isn't explained by information loss alone
The FSI/FDI/CDI metrics provide a concrete protocol to stress-test any TSFM before deployment in variable-SF environments
Until frequency-augmented training is validated, practitioners should retrain or fine-tune per target sampling rate rather than trusting zero-shot generalization across frequencies
Classical Nyquist analysis should be used as a floor: if your TSFM degrades faster than the Nyquist-predicted information loss, the model has a representation problem, not a data problem
More latest news
Read all