Imagine you're in a meeting and someone says "I'm fine" through clenched teeth after being passed over for a promotion. You don't need a dictionary of emotions to read the room — you already noticed the jaw, the pause, the context from ten minutes ago. The problem isn't that you lack information. The problem is that by the time you're asked "how's everyone doing?" your working memory has moved on. This paper argues LLMs have the same problem: they have internal attention heads that track affective cues, but those signals get diluted by the time the model reaches the answer token. The committed claim is this: LLMs contain sparse, identifiable "affective heads" that attend to emotion-bearing tokens in conversation, and you can improve emotion classification without external knowledge by simply amplifying what those heads already do at inference time. The method, Self-targeted Internal Attention Boosting (SIAB), uses activation patching on synthetic minimal pairs — sentences that differ only in emotional valence — to find which heads causally matter for emotion. Then at test time, it boosts the attention weights those heads assign to the content tokens they're already looking at. No labeled emotion lexicons, no external supervision of which spans matter. The ladder is honest but moderate. Evaluated on ECC (earnings call emotion classification) and GoEmotions across three LLMs and multiple prompting settings, SIAB alone lifts prompt-matched baselines by up to +10.3 macro-F1 on ECC and +5.5 on GoEmotions. Combined with PASTA-style external supervision, the gains climb to +13.84 accuracy points and +12.51 macro-F1 points. The baselines are standard prompting configurations (zero-shot, few-shot, chain-of-thought), not purpose-built fine-tuned emotion classifiers, which limits how high up the ladder this climbs. The paper is clear that these are prompting-regime improvements, not claims of beating supervised SOTA. Architecturally, this sits in the growing family of mechanistic interpretability interventions — activation patching, causal tracing, attention head editing — applied to transformer-based LLMs. The specific technique of boosting identified heads at inference time descends directly from PASTA (Zhang et al., 2023), but the key departure is that both the target heads AND the target tokens are derived from the model's own behavior via causal localization, rather than requiring external annotation of which spans to attend to. The paper leans on the structural property that attention heads in transformers are functionally specialized and that this specialization is sparse enough to be identifiable with a small number of synthetic probes. Integrity is mixed. The evaluation uses two established benchmarks (ECC and GoEmotions) across three different LLMs, which is good for generalization claims. The causal localization via synthetic minimal pairs is a principled identification strategy. However, there's no pre-registration, no code release mentioned in the abstract, and the baselines are prompting strategies rather than fine-tuned models. The mechanistic analyses showing layer proximity effects on additivity add credibility — they'd be hard to fabricate — but independent replication on different model families would be the real test. The milestone question is about transfer breadth. SIAB identifies affective heads once and reuses them across tasks — but "across tasks" here means across two emotion classification benchmarks. The next concrete threshold is demonstrating that the same head set transfers to genuinely different affective reasoning tasks: sarcasm detection, empathy in dialogue, sentiment in code-switched multilingual text. If the same ~5-15 heads work across 10+ diverse affective tasks on a given model, that would confirm a real structural finding about how transformers encode emotion. If the heads need re-identification per task family, the practical value shrinks considerably. The obvious experiment not run: fine-tuning. If you identify sparse affective heads, the natural next step is parameter-efficient fine-tuning (LoRA, adapters) targeted at those specific heads. This would test whether the mechanistic insight translates into training efficiency, not just inference-time boosting. My honest read is (c) — they're saving it for the next paper. The AACL acceptance validates the inference-time intervention story cleanly, and fine-tuning experiments would muddy the narrative while opening a different competitive landscape against supervised baselines.
