Imagine you're sorting laundry by color. You don't re-examine each garment from scratch — you tag it once (dark, light, bright) and then compose tags to decide which pile it goes in. That's the Polarity Composition Hypothesis: language models handle negation in natural language inference not by memorizing premise-hypothesis pairs, but by tagging each sentence's polarity and then composing those tags to reach entailment, contradiction, or neutrality. The claim is structural, not just descriptive — the authors say this compositional machinery is causally active inside the model, not merely correlated with outputs. The paper's committed claim: language models solving NLI tasks internally represent polarity as a separable variable, compose it across premise and hypothesis, and this composition is the causal mechanism driving predictions when negation is present. This is not the first paper to study negation in NLI — work from Hossain et al. and Geiger et al. on causal abstraction has laid groundwork — but the specific hypothesis that polarity composition is the right level of causal description, and the demonstration that it transfers across negation types, is a genuine contribution. The authors use Distributed Alignment Search (DAS), a technique from the Geiger et al. causal abstraction lineage, to find low-dimensional subspaces in transformer representations that align with the variables in their proposed causal model. The key architectural bet: if the hypothesis is right, there should be a subspace you can intervene on that changes the model's output exactly as the causal model predicts. They find such subspaces, and critically, show they generalize — representations learned from one negation form (e.g., 'not') transfer to others (e.g., 'never', 'no'), and partially to a subset of MNLI, a standard benchmark. On integrity: behavioral evaluations show model predictions largely conform to the hypothesis, and the DAS interventions provide causal — not just correlational — evidence. The transfer results across negation forms are the strongest card. The partial transfer to MNLI is honestly reported as partial, which is a good sign. However, the validation is ultimately same-team simulation: the authors build the dataset, propose the hypothesis, and test it. No independent replication exists yet. The dataset and code are released, which lowers the barrier. The milestone question is about generalization depth. Right now we have causal evidence for polarity composition in negation-focused NLI. The next concrete number to watch: does this compositional structure hold for more than 2-3 polarity variables, across full MNLI (not a subset), and in models beyond those tested? If a follow-up shows the same subspaces explain 80%+ of negation-related errors on full MNLI across 3+ model families, this framework becomes a diagnostic tool, not just a research finding. The obvious experiment not run: scaling to larger, more diverse models and to full MNLI without subsetting. The honest read is (a) — compute and annotation budget. Building the controlled dataset is labor-intensive, and DAS interventions at scale on frontier models are expensive. The partial MNLI transfer result strongly suggests the authors tried full MNLI and hit diminishing returns, but they report the partial result honestly rather than hiding it. Accepted at EACL 2027 main conference, this is a solid mechanistic interpretability paper that asks the right question — not 'can models handle negation?' but 'what is the internal causal structure when they do?' — and provides real, if bounded, evidence for a specific answer.
The analogy
Like sorting laundry by tagging each garment's color once and composing tags to decide piles — not re-examining every item from scratch. The paper claims language models tag each sentence's polarity and compose those tags to decide NLI labels, and this composition happens in identifiable internal subspaces you can surgically intervene on.
Laundry sorting
Tag each garment once (dark/light/bright), then compose tags to assign piles — no need to re-examine the full garment each time
Polarity composition
Tag each sentence's polarity in a subspace, then compose polarity tags across premise-hypothesis to produce entailment/contradiction/neutral
Honest assessment
A well-constructed mechanistic interpretability study that proposes a specific, testable compositional account of negation handling in NLI and backs it with causal (not just correlational) evidence. The transfer results across negation forms are genuinely informative; the partial MNLI result is honestly bounded. This is not a breakthrough — it's a solid brick in the causal abstraction wall. Most useful to researchers building interpretability tools for NLI systems, and to anyone who wants to understand what's actually happening inside a model when it encounters 'not.'
What Is CLAIMS?
70
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
3/5
Ladder
3/5
Architecture
4/5
Integrity
3/5
Milestone
4/5
Successor
4/5
What is this paper actually committing to?
Real but Nth iteration. Polarity composition is a specific, testable claim within the established causal abstraction paradigm. The novelty is the specific hypothesis and its cross-negation transfer, not the method.
The field fight
Should we understand LLM internal computation through behavioral probing or through causal intervention on representations?
Side A
Behavioral probes and accuracy benchmarks are sufficient to characterize model capabilities
Held by: Probing classifiers, challenge-set evaluation, behavioral NLI benchmarks
Side B
Only causal interventions on internal representations can distinguish real mechanism from correlation
Held by: Geiger et al., DAS, causal abstraction, interchange interventions, this paper
Milestone tracker
Unlocks: A deployable diagnostic for negation failures in NLI systems, not just a research finding
Current
partial
MNLI transfer
this paper
Next
≥80%
negation errors explained on full MNLI
diagnostic tool threshold
~1-2 years if picked up with more compute and broader model coverage
Verified Facts (5)
Authors: Nhi Hoai Doan, Tatsuya Hiraoka, Munachiso Samuel Nwadike, Kentaro Inui
Accepted to EACL 2027 (main conference)
Method: Distributed Alignment Search (DAS)
Representations transfer across negation forms and partially to a subset of MNLI
Dataset and code released
Practical Implications (3)
If you're debugging NLI model failures on negation, the polarity-composition framing gives you a specific internal variable to look for — not just 'the model gets negation wrong' but 'the polarity subspace is misaligned'
The DAS methodology demonstrated here could be applied to other compositional phenomena beyond negation (quantifiers, modals, conditionals) using the same experimental template
Released dataset provides a controlled testbed for anyone studying negation in NLI — no need to build your own from scratch
More latest news
Read all