
Read the paper
Semifactual Credit-Augmented Policy Optimization
on GitHub
Imagine you're grading a student's math proof, and you suspect some steps are real reasoning while others are just pattern-matching off the specific wording of the question. So you rephrase the question — same math, different words — and watch which steps wobble. The steps that stay firm are load-bearing logic; the ones that shift are likely cribbing from surface features. That's exactly what SCAPO does to large language models during reinforcement learning. The committed claim: GRPO's uniform advantage assignment — giving every token in a correct response the same reward signal — actively reinforces spurious dependencies on task-irrelevant prompt features. SCAPO fixes this by measuring each token's probability drift under semifactual interventions (rephrased prompts that preserve the underlying problem) and downweighting tokens that are unstable. This is not a new RL algorithm; it's a causally motivated credit-assignment patch grafted onto GRPO's existing machinery. The results are concrete. On Qwen3-4B-Base, SCAPO beats GRPO on AIME 2024–2026 by 5.63 percentage points. On Qwen3-1.7B-Base, the gap is 4.17 points. Crucially, the gains extend to out-of-distribution benchmarks — the paper reports best-in-class results on all evaluated OOD tasks at both scales, which is the real test of whether you've reduced spurious dependence or just overfit harder. The method also works at inference time without any training: suppressing high-drift token candidates during decoding improves accuracy on its own. Architecturally, SCAPO lives in the policy-gradient family (specifically GRPO's clipped-ratio framework), but its novelty is entirely in the credit-assignment mechanism. It generates semifactual prompts — surface-level paraphrases that preserve the mathematical content — computes token-level KL divergence between original and semifactual response distributions, converts these into normalized stability scores, and uses them to scale down per-token advantages for unstable tokens during early training. Stability alone gets no bonus; only instability is penalized. The compute overhead is the cost of generating semifactual prompts and running forward passes under them, which the paper doesn't quantify explicitly. The integrity picture is decent but not airtight. The benchmarks are community standards (AIME, AMC, MATH-500, Minerva Math, OlympiadBench), which is strong. Baselines include GRPO, DAPO, and Dr.GRPO — current methods, not stale ones. Code is released on GitHub. But there's no pre-registration, no independent replication, and the semifactual generation process itself could introduce confounds: how do you guarantee that a paraphrase truly preserves the underlying problem? The paper acknowledges this implicitly by restricting to math, where semantic equivalence is more verifiable, but the boundary is fuzzy. The successor question is obvious: does this work on non-math reasoning, and does it scale to larger models? Math is the easiest domain for semifactual interventions because you can verify semantic equivalence relatively cleanly. Code, logic, science QA — these are harder. The authors stayed at 1.7B and 4B parameters. My read: they're saving the 7B+ experiments for the next paper, and the non-math domains are genuinely harder to crack because semifactual generation becomes less reliable. The compute cost of generating and evaluating semifactuals at scale is also non-trivial, and the paper is quiet about wall-clock overhead — likely because the numbers aren't flattering. What makes this paper worth your time isn't the magnitude of the gains — 4–6 points on AIME is meaningful but not paradigm-shifting. It's the diagnostic framework. The semifactual intervention lens gives you a way to audit any RLVR-trained model for spurious prompt dependence, and the token-level stability scores are a reusable tool. If you're building reasoning systems with GRPO or its variants, this is a concrete, implementable improvement with released code. If you're watching the RLVR space more broadly, the real question is whether causal credit assignment becomes standard practice or stays a niche technique.
The analogy
You're grading a student's math proof and suspect some steps are real reasoning while others just parrot the question's wording. So you rephrase the question — same math, different words — and watch which steps wobble. The wobbly steps get marked down. That's SCAPO: rephrase the prompt, measure which tokens flinch, penalize the flinchers during training.
Exam rephrasing
Reword a test question without changing the math; see which proof steps a student rewrites vs. keeps
Semifactual credit
Paraphrase the prompt preserving the problem; measure token probability drift and downweight unstable tokens in GRPO advantage
Honest assessment
SCAPO is a well-motivated, cleanly implemented credit-assignment fix for a real GRPO weakness, with honest baselines and released code. The 4–6 point AIME gains and consistent OOD improvements are convincing at the tested scales. The open questions — scaling to larger models, non-math domains, compute overhead — are the difference between a nice workshop paper and a field-standard technique. Worth implementing if you're running GRPO pipelines today; worth watching if you care about whether causal reasoning enters mainstream RLVR.
What Is CLAIMS?
70
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
3/5
Ladder
4/5
Architecture
4/5
Integrity
3/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Real but incremental: a credit-assignment patch on GRPO, not a new RL paradigm. The semifactual framing is the genuine insight — connecting causal reasoning to token-level reward shaping in RLVR is new.
The field fight
Should RLVR assign uniform credit to all tokens in a correct response, or use finer-grained token-level signals?
Side A
Uniform outcome-level advantage is sufficient; complexity isn't worth it
Held by: GRPO, standard RLVR pipelines
Side B
Token-level credit assignment is necessary to avoid reinforcing spurious dependencies
Held by: Dr.GRPO (step-level), SCAPO (semifactual stability), this paper
Milestone tracker
Unlocks: If gains hold at scale + non-math domains, semifactual credit becomes a default RLVR component
Current
4B
params
largest tested
Next
14B+
params
production-scale RLVR
~6-12 months given RLVR research pace
Verified Facts (5)
SCAPO improves AIME 2024-2026 accuracy over GRPO by 5.63 percentage points on Qwen3-4B-Base
SCAPO improves AIME 2024-2026 accuracy over GRPO by 4.17 percentage points on Qwen3-1.7B-Base
At both model scales, SCAPO achieves the best results on most evaluated mathematics benchmarks and all evaluated out-of-distribution benchmarks
Suppressing high-drift token candidates during decoding improves reasoning accuracy without updating model weights
The code is available at https://github.com/DtYXs/SCAPO
Practical Implications (4)
If you train LLMs with GRPO, SCAPO is a drop-in credit-assignment improvement with released code — test it on your pipeline
The inference-time token suppression trick works without retraining and could be applied to existing deployed models as a quick robustness patch
Semifactual prompt perturbation is a reusable diagnostic tool: use it to audit any RLVR model for spurious prompt dependence before deployment
Expect the RLVR community to start treating per-token credit assignment as default rather than optional within 12 months
More latest news
Read all