Read the paper
General progress substitutes for specific training data in language models
on GitHub
You know how a kid who's never been taught long division but has spent years doing arithmetic can pick it up in an afternoon? That's the core mechanism here. Marosi and Antal systematically withheld specific training signals — individual chess rules, molecular string grammars, programming languages — and watched what happened as models got better at everything else. The withheld skill emerged anyway, partially, and the gap closed faster the more the model had learned in general. The committed claim: general progress on a model's broader training distribution substitutes for the specific data that was withheld, and the amount of that specific data needed to regain the skill decreases as the model improves. This is not a vague scaling-law observation. They demonstrate it across five domains — chess, Othello, molecular strings (SMILES), bracket languages, and web text — with a 7-billion-parameter model in the web-text case. A chess model never trained to respond to check ranked legal responses almost as well as one that was. A programming language filtered out of web text was relearned with a fraction of the original data. The experimental design is careful. They train models from scratch, withholding specific skill data at the token level, then measure both how much the withheld skill emerges without retraining and how quickly it's regained with targeted fine-tuning. Crucially, they include control tasks of comparable difficulty that the model had not implicitly practiced through general training. Those controls learned much more slowly, ruling out the trivial explanation that bigger models just learn everything faster. The ladder here is less about beating a baseline and more about establishing a phenomenon. Prior work has gestured at "emergent capabilities" and scaling laws, but this paper isolates the substitution effect experimentally. The closest precedent is Neel Nanda's Othello work and broader mechanistic interpretability research, but nobody has run this specific ablation across five domains with the control-task design. The scaling prediction — that delay curves from smaller models predict larger ones — is the methodological contribution that gives this real teeth. Integrity is solid but bounded. All five domains are simulation or synthetic-ish (chess engines, grammar generators, SMILES strings, bracket languages, web text with known filtering). No external pre-registration, but the code is released, the experimental protocol is transparent, and the multi-domain replication is genuine. The control-task design is the strongest internal check — without it, this paper would be much weaker. The 7B web-text experiment is the most externally valid test, but it's only one programming language (not named in the abstract), which limits how much weight you can put on that single data point. The implications for AI safety are direct and sobering. Data filtering — removing dangerous knowledge from training corpora — is a primary alignment strategy for frontier labs. This paper shows that filtering delays capability acquisition but does not prevent it, and that the delay shrinks as models get better at other things. If this holds at frontier scale, it means the window during which filtered capabilities stay filtered is narrowing with every generation of model improvement. The practical question becomes: how long is the delay, and does it still matter when models can be fine-tuned with tiny amounts of the withheld data? What the paper does not do is demonstrate this at frontier scale on a genuinely dangerous capability. The five domains are well-chosen for experimental control but none of them is bioweapons synthesis or zero-day exploit generation. The jump from "a 7B model relearns a filtered programming language" to "GPT-5 relearns CBRN knowledge" is non-trivial and unproven. The authors are appropriately careful here, but the safety community will need frontier-scale replication before this changes policy.
The analogy
Imagine a musician who's never been taught jazz but has spent 10,000 hours on classical piano, blues, and rhythm exercises. Hand them a jazz chart and they'll sight-read it passably on the first try — and after 20 minutes of practice they'll play it like they've known it for weeks. The general musical skill substitutes for the specific genre training, and the gap closes faster the better the musician already is.
Cross-trained musician
General musical proficiency lets a pianist pick up an untrained genre quickly because the underlying structures transfer
LM skill substitution
General training progress lets a model acquire a withheld skill partially for free and relearn it fully with minimal targeted data
Honest assessment
This is a well-designed empirical paper that establishes a real phenomenon with direct safety implications: data filtering delays but does not prevent capability acquisition, and the delay shrinks with scale. The five-domain design and control tasks make the core finding robust, but the gap between 7B-parameter models and frontier systems is vast. The safety community should take this seriously as a warning shot, but the policy-relevant question — does this hold at 70B+ on dangerous capabilities — remains unanswered. Engineers and safety researchers should read this; policymakers should wait for the frontier-scale follow-up.
What Is CLAIMS?
73
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
3/5
Integrity
4/5
Milestone
4/5
Successor
4/5
What is this paper actually committing to?
Genuine first: experimentally isolates that general training substitutes for withheld skill data, demonstrated across five domains with control tasks. Not incremental — this is a new empirical phenomenon with direct safety implications.
The field fight
Is data filtering a durable strategy for preventing dangerous AI capabilities?
Side A
Filtering training data is a viable containment layer — remove the knowledge, remove the capability
Held by: Frontier lab safety teams, NTIA, most governance proposals
Side B
Filtering is a temporary delay at best — general capability growth substitutes for specific data, and fine-tuning erases the gap
Held by: This paper, scaling-law skeptics, open-source safety researchers
Milestone tracker
Unlocks: Definitive evidence on whether data filtering is viable as a safety strategy for frontier models
Current
7B
params
this paper
Next
70B+
params
frontier-scale replication
~1-2 years if compute access available
Verified Facts (7)
Authors withheld training signal for individual skills in models of chess, Othello, molecular strings, bracket languages and web text
A chess model never explicitly trained to respond to check ranked the legal responses almost as well as a model that was
When models were then trained on the withheld data, they acquired the skill with a small fraction of the data needed from initialization
A control rule of equal difficulty was learned much more slowly
A programming language withheld from the training text of a 7-billion-parameter model was regained in the same way
49 pages, 16 figures, 6 tables
Code: https://github.com/Mapika/progress-substitutes-data
Practical Implications (4)
Data filtering as a safety strategy should be treated as a delay mechanism, not a containment mechanism — plan accordingly
Fine-tuning attacks on filtered models will require less data than expected, and that data requirement drops as base models improve
Safety teams should model the substitution curve for their specific filtered capabilities and estimate when the delay window closes
The control-task experimental design introduced here is a reusable tool for testing whether any specific filtering intervention is durable
More latest news
Read all