Imagine you're a student cramming from textbooks published across different decades. Some facts — the speed of light, the capital of France — appear identically in every edition. Others — the current GDP of Nigeria, the best-performing mutual fund — shift year to year. You'd expect the stable facts to be easier to learn. The surprise: the volatile facts end up being the ones you know best by exam day, because they forced you to encounter the topic from more angles. That's the core finding here. Su et al. define a Temporal Variability Score (TVS) — the coefficient of variation of an item's negative log-likelihood across point-in-time models trained on web snapshots from different years. High-TVS items are facts whose representation in training data shifts meaningfully across years. Low-TVS items are the bedrock that barely changes. The committed claim: high-TVS items are learned faster in later pretraining and outperform low-TVS items in 34 of 36 model-benchmark settings, with an average advantage of 7.3 percentage points of chance-normalized accuracy. The experimental ladder is honest but modest. The authors evaluate six benchmarks (covering diverse topics from general knowledge to domain-specific questions) across six open-source models from multiple families. There is no single named SOTA to beat here — this isn't a performance paper. It's a diagnostic paper. The contribution is the TVS metric itself and the empirical regularity it reveals. The baselines are the low-TVS items within the same benchmarks, which is a clean within-study comparison. But the lack of a competing explanatory framework to beat against (say, curriculum learning metrics or data-mixture diagnostics) means the ladder is self-referential. Architecturally, this is a measurement study, not a methods paper. The point-in-time models serve as probes — each trained on a web snapshot from a different year, allowing the authors to compute how much a given fact's likelihood varies across temporal slices. The TVS is just a coefficient of variation, which is deliberately simple. The method leans entirely on the existence of multiple open-source model families with point-in-time variants, which is a relatively recent artifact of the open-weights ecosystem. Integrity is reasonable for a diagnostic paper. Six benchmarks, six models, multiple model families — that's 36 settings, and the pattern holds in 34 of them. The authors control for item difficulty, which is the obvious confounder (volatile facts might just be easier). The finding survives that control. But there's no pre-registration, no code release mentioned, and the entire validation regime is observational — the authors are measuring correlations between TVS and learning dynamics, not running causal interventions. The direction of causality (does temporal volatility cause faster learning, or does some third factor drive both?) is left open. The milestone question is where this gets interesting for practitioners. If TVS proves to be a reliable diagnostic, it could inform data curation — telling you which knowledge domains need more temporal diversity in training data, and which are adequately covered by any single snapshot. The concrete next number: does TVS predict performance on held-out temporally-tagged knowledge benchmarks (e.g., questions about events from specific years)? That would move this from correlation to actionable signal. We're probably 1-2 papers away from that test. The obvious experiment not run: an intervention study where you deliberately manipulate temporal diversity in the training data for specific knowledge domains and measure whether high-TVS items lose their advantage when the temporal signal is flattened. The honest read is (a) — this would require retraining models from scratch with controlled data mixtures, which is expensive. The authors are working with existing checkpoints, not training their own. The diagnostic insight is real; the causal mechanism is left for someone with more compute.
