Tiny Encoders That Know What Year It Is Beat General Retrievers on Earnings Calls

33.8M-param text encoders trained with yearly cutoffs eliminate look-ahead bias in financial backtests while outperforming general-purpose retrievers on every test quarter.

Imagine you're studying for a history exam, but your textbook keeps updating itself with tomorrow's headlines. Every time you answer a question about 1945, your notes already contain facts from 2024. You'd ace the test — but you'd learn nothing about how knowledge actually unfolds. That's the look-ahead bias problem in financial backtesting, and this paper builds a disciplined fix. The committed claim: domain-specific text encoders trained with strict temporal cutoffs — "vintages" — outperform general-purpose retrievers on earnings-call QA while eliminating the data leakage that plagues most financial NLP backtests. From 412,248 earnings calls spanning roughly 15 years, the authors train encoder families under four pretraining recipes (MLM, SimCSE, TSDAE, RetroMAE) with yearly cutoffs from 2010 to 2024. Each vintage reads only text dated on or before its cutoff. At just 33.8M parameters, these purpose-built models beat every general retriever tested — including much larger ones — on held-out call retrieval in every test quarter. The ladder here is clear and honestly reported. Against general-purpose retrievers (likely Sentence-BERT variants, E5, or similar), the domain vintages win on retrieval across the board. For return forecasting, the vintages add about half the rank correlation when combined with past-return and firm-size signals — a meaningful but modest lift. Critically, the authors are upfront that on return forecasting specifically, point-in-time vintages offer no advantage over a single static encoder. The gain concentrates on retrieval quality and earnings-surprise prediction, not the holy grail of return prediction. Architecturally, this sits in the masked-language-model encoder family — small transformer encoders (33.8M params, likely BERT-mini or DistilBERT scale) pretrained and then fine-tuned on call QA pairs. The four pretraining recipes span the standard self-supervised spectrum for retrieval: MLM for general language modeling, SimCSE for contrastive sentence representations, TSDAE for denoising autoencoding, and RetroMAE for retrieval-oriented masking. The key structural choice is sequential training — each vintage initializes from the previous year's checkpoint, which the paper shows lets later vintages retroactively improve retrieval even on earlier quarters. Integrity is above average for financial NLP. The temporal discipline is the paper's entire point, and the authors test it rigorously: each vintage is evaluated only on calls it could not have seen. The sequential-vintage finding — that continuing training from a prior vintage beats training from scratch — is interesting and tested against the natural baseline. The earnings-surprise forecasting gain is reported honestly: the confidence interval includes zero on unseen calls. Code is released. The main gap is the absence of named general-retriever baselines with specific model identifiers and version numbers in the abstract. The milestone framing is practical: 33.8M-parameter vintaged encoders are cheap enough to retrain yearly, making temporal discipline feasible for production RAG systems in finance. The next threshold is whether this protocol scales to larger encoders (100M-400M params) and whether the retrieval gains translate into measurable alpha when piped through a full trading system rather than just rank-correlation improvements on next-day returns. The obvious experiment not run: plugging these vintaged retrievers into a live or paper-traded portfolio and measuring P&L, not just rank correlation. The authors likely didn't run this because (a) it requires brokerage infrastructure and transaction-cost modeling outside the scope of an NLP workshop paper, and (b) the return-forecasting results already show the gains are slim — a full backtest might show nothing, which would weaken the paper's narrative. Saving the positive-result story (retrieval + earnings surprise) for this venue, leaving the harder test for follow-on work, is the honest read.