Read the paper
Clover-35B-A3B-Preview Technical Report
on GitHub
QUESTION ACCURACY
+90.37%
KEY METRIC
+93.88%
GROUP ACCURACY
+65.4%
KEY METRIC
+77.0%
Imagine you're writing a letter but instead of choosing one word at a time left-to-right, you sketch the whole page in pencil first, then erase and redraw sections until the message is sharp. That's block diffusion for language: generate a chunk of tokens simultaneously, refine them iteratively, then move on. Now imagine that while sketching each new block, you can glance at a compressed notebook of everything you've already finalized — that notebook is the recurrent memory. Clover's core trick is making the notebook compete directly with the current sketch for the model's attention budget, so the system learns when to lean on context versus when to focus on the tokens it's actively denoising. The committed claim: Clover is the first mixture-of-experts diffusion language model to combine Gated Delta Networks (a linear-recurrence mechanism) with bidirectional softmax attention inside a block-diffusion framework, at a scale (35B total, 3B active) that is competitive with autoregressive frontier models on agentic coding benchmarks. That's three architectural novelties stacked — MoE sparsity, block diffusion, and recurrent memory — in one model that actually ships weights. On the ladder, the headline numbers are strong on paper. SWE-bench Verified at 73.6 and Terminal-Bench 2.1 at 51.7 lead seven evaluated agent metrics. The report claims 680 tokens per second on a single NVIDIA GB300 at BF16 batch-size-one — a throughput figure that would be remarkable for a 3B-active model, let alone one doing iterative denoising. But the ladder is incomplete: the report does not name the specific autoregressive baselines it beats on these benchmarks, nor does it provide head-to-head numbers against Claude 3.5 Sonnet, GPT-4o, or DeepSeek-V3 on SWE-bench. Without that, 73.6 floats without context. Architecturally, Clover sits at an unusual intersection. It belongs to the discrete diffusion family (MDLM, SEDD, Block Diffusion) but grafts on a recurrent state mechanism from the Gated Delta Net lineage (DeltaNet, Mamba-adjacent linear attention). Historical memory readout competes with current-block tokens in a shared softmax — a gating mechanism that lets the model decide per-head how much to trust compressed history versus live bidirectional context. A separate zero-initialized right-context convolution branch handles causal leakage at block boundaries. The MoE routing (35B total, 3B active) keeps inference cheap. There's also a decision-model variant that jointly answers related questions in one denoising pass, boosting group accuracy from 65.4% to 77.0% on an internal 500-group set. Integrity is the weak link. All reported benchmarks appear to be self-evaluated. The 'internal agent workloads' are undefined — no dataset cards, no independent reproduction. The seven agent metrics are named only by benchmark, not by methodology or evaluator. The 680 tok/s figure is on unreleased NVIDIA GB300 hardware, making independent verification currently impossible. Code and weights are released, which is a strong signal, but no one has yet run them. The decision-model evaluation uses an 'internal set of 500 groups' — zero external visibility. The milestone question is about diffusion LMs closing the gap with autoregressive models on general-purpose benchmarks, not just agent tasks. Clover shows competitive agent scores but provides no MMLU, HumanEval, or general reasoning numbers. The field needs a diffusion LM that matches autoregressive performance across the standard suite at comparable active-parameter counts. Clover might be close, but doesn't show it. The obvious experiment not run: general-purpose benchmarks (MMLU, GPQA, MATH, HumanEval) head-to-head against autoregressive models at similar active parameter counts. The honest read is (c) — they're saving it for the full release. A 'Preview' technical report that leads with agent benchmarks and skips general reasoning is a deliberate framing choice, not an oversight.
The analogy
Imagine writing a letter by sketching the whole page in pencil, erasing and redrawing until it's sharp, while consulting a compressed notebook of everything you've already finalized. That notebook competing with your live sketch for your attention — that's Clover's core mechanism: recurrent memory gated against current-block bidirectional attention in a diffusion denoising loop.
Pencil draft
Sketch a full page, erase and refine sections, consult a notebook of finalized pages to stay coherent
Block diffusion
Denoise a block of tokens simultaneously, refine iteratively, read compressed recurrent memory of prior blocks via shared softmax gating
Honest assessment
Clover is architecturally the most ambitious diffusion language model released to date — stacking MoE, block diffusion, and recurrent memory in one model with public weights. The agent benchmark numbers are eye-catching. But this is a preview report with no autoregressive head-to-head comparisons, no generalist benchmark scores, opaque internal evaluations, and throughput claims on hardware no one else has. The architecture deserves serious attention; the claims need independent verification before they mean anything. Engineers building agent pipelines should watch the community reproduction closely. Everyone else should wait for the full report.
What Is CLAIMS?
57
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
2/5
Architecture
4/5
Integrity
2/5
Milestone
2/5
Successor
3/5
What is this paper actually committing to?
Genuinely novel architecture stack: MoE + block diffusion + Gated Delta Net recurrence in one model at 35B scale with released weights. Three novelties stacked, not just one incremental twist.
The field fight
Can diffusion-based language models replace autoregressive generation for general-purpose and agentic tasks?
Side A
Autoregressive generation scales reliably and dominates all benchmarks; diffusion for discrete text is a research curiosity
Held by: GPT-4o, Claude, Llama, DeepSeek-V3
Side B
Block diffusion enables parallelism, speculative decoding, and joint reasoning that autoregressive models structurally cannot match
Held by: MDLM, SEDD, Block Diffusion, this paper
Milestone tracker
Unlocks: Diffusion LMs as credible drop-in replacements for autoregressive models across all deployment scenarios
Current
73.6
SWE-bench Verified
Clover (agent tasks)
Next
85+
MMLU at ≤7B active
Diffusion LM generalist parity
Unknown — no generalist scores reported; could be 6 months or 2 years
Verified Facts (10)
35 billion total parameters and 3 billion activated parameters
73.6 on SWE-bench Verified
51.7 on Terminal-Bench 2.1
680 tokens/s using one NVIDIA GB300 GPU at BF16 precision and batch size one
Joint prediction raises question accuracy from 90.37% to 93.88%
All-correct group accuracy from 65.4% to 77.0%
Internal set of 500 groups for decision-model evaluation
Adapts Gated Delta Networks to block diffusion
Zero-initialized right-context convolution branch
Leads seven evaluated agent metrics
Practical Implications (4)
If throughput claims hold, 680 tok/s at 3B active parameters on a single GPU could make diffusion LMs viable for latency-sensitive agent deployments
Joint decision-model variant (65.4% → 77.0% group accuracy) suggests block diffusion has structural advantages for multi-question reasoning tasks
MoE + block diffusion combination could enable new speculative decoding strategies where draft and verify happen within the same denoising pass
Released weights on HuggingFace mean the community can test agent performance immediately — watch for independent SWE-bench reproductions
More latest news
Read all