
Read the paper
Reading Why: Born-Measured Attention with Exact Word Evidence on Light and Qubits
on GitHub
ANSWER
+45%
PAIRS OUT
+53%
SAME WAY
+32%
ATTENTION GRADIENT
+40%
Imagine you're mixing paint. You combine red and blue and get purple — but you can't unmix the purple back into its components to prove how much red versus blue went in. That's the explainability problem in neural networks: the output is a blend, and attribution methods like integrated gradients are always approximations — you're guessing at the recipe from the color. This paper builds a mixer where the recipe IS the color: every operation is a Born measurement (probability = amplitude squared), so the contribution of each input word to the output is a closed-form polynomial you can integrate exactly. No estimation, no approximation error. The evidence sums to the class probability above baseline to 10⁻¹¹ precision. The committed claim: a transformer architecture where attention is |⟨q|k⟩|⁴ (Born rule), the feed-forward layer is replaced by a measured product, and the readout is another Born measurement — yielding exact integrated-gradient attribution as a mathematical identity, not an approximation. The model matches a same-size softmax transformer on e-SNLI natural language inference (76.98% vs 76.62%, within error bars), with ~98k non-embedding parameters. This isn't a toy: it's a real NLI task with real sentences. The explainability results are where the paper earns its keep. Deleting the word ranked most important by the Born model's exact evidence changes the answer in 45% of test pairs — out of a theoretical maximum of 53% (pairs where any single deletion can flip the label). The softmax transformer explained by the same integrated-gradient method only hits 32%; even attention × gradient only reaches 40%. The Born model's attributions aren't just mathematically exact — they're functionally more informative about what actually drives the prediction. Interestingly, attention-based rankings look more like human annotations but are less predictive of answer changes, a sharp reminder that 'looks like what humans highlight' and 'actually explains the model' are different questions. Architecturally, this is a variational-style quantum-native transformer. Every operation maps to a unitary circuit: attention becomes interference between query and key states, the nonlinearity becomes a projective measurement, and the whole thing compiles to 852 CNOTs on 23 qubits for a single coherent attention layer. The authors ran this on IBM's ibm_kingston device with Hadamard tests reading attention overlaps. On two short test pairs, the device reproduced the model's answers and its deletion behavior — but the fine-grained evidence values did not survive hardware noise. The paper is honest about this: they calculate the shot budget and calibration needed to make evidence measurement work on hardware, rather than claiming it already does. The ladder comparison is straightforward but limited. The only baseline is a same-size softmax transformer on e-SNLI. There's no comparison to larger models, to post-hoc explainability methods beyond integrated gradients and attention × gradient, or to other inherently interpretable architectures. The 76.98% accuracy is respectable for a 98k-parameter model but nowhere near SOTA on NLI (which exceeds 90% with large pretrained models). The paper doesn't claim SOTA accuracy — it claims exact explainability at competitive accuracy for its size class — but the narrow baseline set leaves the ladder position somewhat uncertain. Integrity is mixed but more honest than most. The mathematical claim (exact attribution) is provable and the authors demonstrate it numerically to 10⁻¹¹. The hardware demonstration is a proof-of-concept on two test pairs — the authors explicitly state where it fails and what would be needed to fix it. Code, trained models, notebooks, and every IBM job record are public. But there's no pre-registration, no independent replication, and the benchmark choice (e-SNLI at small scale) was presumably made knowing the model would perform competitively there. The deletion-based evaluation is the strongest integrity signal: it's a functional test that's hard to game. The obvious next experiment is scaling: does this architecture hold up at 1M+ parameters, on harder tasks, with longer sequences? The quadratic Born attention and the polynomial evidence computation both face scaling questions the paper doesn't address. The honest read is (a) — they built the conceptual framework and demonstrated it at the smallest viable scale, and scaling requires compute and engineering they haven't yet invested. The quantum hardware experiment similarly needs better devices; ibm_kingston's noise floor is the binding constraint, not the architecture.
The analogy
Imagine mixing paint: you combine colors and get a result, but you can't unmix the blend to prove exactly how much of each color went in. Standard neural nets are like that — attribution is always reverse-engineering the recipe from the output. This paper builds a mixer where the recipe IS the output: every step is a quantum measurement, so each ingredient's contribution is a closed-form polynomial you can compute exactly. No guessing, no approximation.
Paint mixing
Once colors blend, you can only estimate each pigment's contribution by approximation — you can't unmix the result
Born transformer
Every layer is a Born measurement, so each word's contribution to the output is a polynomial you can integrate exactly — no unmixing needed
Honest assessment
This is a genuinely novel construction — a transformer where explainability is a mathematical theorem, not a numerical estimate — demonstrated at small scale with honest hardware experiments. The conceptual contribution is real: if you buy that exact attribution matters, this is the first architecture that delivers it. But the practical impact is gated on two things the paper doesn't demonstrate: scaling to model sizes where explainability actually matters for deployment decisions, and quantum hardware good enough to measure evidence values (not just predictions). Right now this is a proof of concept with a beautiful mathematical core and a narrow empirical validation. Engineers working on AI safety/explainability should read it for the construction principle; quantum computing researchers should note the clean classical-to-quantum compilation. Everyone else can wait for the scaling paper.
What Is CLAIMS?
67
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
2/5
Architecture
4/5
Integrity
3/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Genuine novelty: a transformer where every operation is a Born measurement, yielding exact integrated-gradient attribution as a mathematical identity. Not just a methods tweak — a new construction principle with provable properties.
The field fight
Should neural network explainability be approximate post-hoc analysis, or should models be built so attribution is exact by construction?
Side A
Post-hoc methods (SHAP, IG, attention visualization) are sufficient and don't constrain model design
Held by: Integrated Gradients, SHAP, attention-based explanations, most of XAI
Side B
Approximate attribution is fundamentally unreliable; models should be constructed so explanations are mathematically exact
Held by: This paper, inherently interpretable architectures
Milestone tracker
Unlocks: Proof that exact attribution survives at scales where explainability actually matters for deployment trust
Current
98k
params
this paper (e-SNLI)
Next
1M+
params
harder NLU tasks
~1-2 years with engineering investment; hardware evidence measurement ~3-5+ years
Verified Facts (9)
Model reaches 76.98 ± 0.17% test accuracy on e-SNLI with about 98k parameters outside the embedding
Softmax transformer of the same size reaches 76.62 ± 0.36% test accuracy
Deleting the word ranked first by Born evidence changes the answer in 45% of test pairs, out of 53% any single deletion can change
Softmax model explained the same way: 32%; by attention × gradient: 40%
Attention-based word ranking changes Born Transformer answer in 32% of pairs
Coherent attention layer compiles to 852 CNOTs on 23 qubits
Word contributions sum to class probability above no-information share to 10⁻¹¹ or better
Hardware tested on IBM ibm_kingston; device gave model's answers on two short test pairs
Evidence itself did not survive the device noise
Practical Implications (3)
If exact attribution scales, it could replace approximate explainability methods (SHAP, IG) in safety-critical NLP deployments where regulators demand provable explanations
The Born transformer compiles directly to quantum circuits, offering a concrete use case for near-term quantum hardware beyond optimization and chemistry
The deletion-test methodology (deleting top-ranked word and measuring answer change) is a reusable evaluation protocol for any explainability method, independent of this architecture
More latest news
Read all