
ASSIGNS
+72%
TANGENT GRAD-CAM PRODUCES
+44%
PREDICTION DISPLACEMENT UNDER
+10%
INK COLOR
+20%
Imagine you're giving someone driving directions, and they write down both the street names and the color of ink you used. When asked later what mattered, they report the ink color as 20% of the signal. That's what happens when you apply standard attribution methods to networks that predict directions: the explanation faithfully tracks changes in raw coordinates that the decoder's normalization step will erase. The ink color is real gradient signal — it's just irrelevant to where you end up. The committed claim: when neural networks use fixed decoders like normalization (mapping raw outputs to unit vectors for angles, gaze, rotations), attributing through the raw coordinates contaminates explanations with radial (magnitude) signal that has zero effect on the final prediction. The fix is to attribute through the decoder's differential — which for normalization reduces to a tangent-plane projection. This is not a new attribution method; it's a correction layer you bolt onto existing methods like Grad-CAM and Integrated Gradients. The numbers are concrete and damning. On synthetic tasks where ground-truth relevance is analytically known, ambient (standard) attribution assigns up to 72% of its mass to a provably irrelevant input region. That's not noise — it's the majority of the explanation pointing at nothing. On MPIIGaze, tangent Grad-CAM yields 44% greater prediction displacement under pixel deletion, meaning it identifies genuinely important pixels much more accurately. On PASCAL3D+ with a 6D rotation decoder, the full differential attribution improves mean deletion displacement by 14.1 degrees over ambient coordinate sums. The architecture insight here is elegant in its simplicity. The paper identifies two distinct failure modes — radial contamination (magnitude signal leaking into direction explanations) and scalarization loss (collapsing multi-dimensional outputs into a scalar before attributing). By separating these, they can diagnose which failure mode dominates for a given task. The tangent projection kills radial contamination; using the full Jacobian instead of a trace/sum addresses scalarization loss. The theoretical contribution — proving that every fixed smooth scalar target on a sphere has points of zero tangential sensitivity — explains why naively projecting Integrated Gradients into angular space doesn't fully solve the problem. Integrity is mixed but honest. The synthetic experiments are the strongest evidence: analytically known relevance means you can measure misattribution exactly, not just correlate with proxy metrics. The real-data experiments (MPIIGaze, PASCAL3D+) use standard benchmarks with deletion metrics, which is the community norm but inherently indirect. Critically, the authors report mixed results for their two-polarity tangent LayerCAM variant — it works on circular regression but shows no detectable difference on quaternion pose. Papers that report their own nulls earn credibility. The practical scope is narrower than the theory is interesting. This matters for any network ending in normalization, arctan2, quaternion decoding, or similar fixed geometric decoders — gaze estimation, head pose, rotation prediction, any angular regression task. It does NOT apply to classification networks or networks with learned decoders. The fix requires computing the decoder Jacobian, which for normalization is cheap (a rank-1 update), but for more complex decoders could add nontrivial overhead. The successor question is straightforward: the authors tested on three tasks with two decoder families (normalization, 6D rotation). The obvious next experiment is scaling to richer geometric outputs — SE(3) pose estimation with coupled rotation and translation, or multi-joint human pose where dozens of angles interact. The honest read is (a): they demonstrated the principle cleanly on tractable cases and left the messy, high-dimensional validation for follow-up. The paper also candidly notes that invariant attribution can still miss inputs that drive prediction, which means deletion checks remain necessary — invariance alone is not sufficient.
The analogy
Imagine giving someone driving directions, and they write down both the street names and the ink color you used. Standard attribution on normalized outputs is like reporting the ink color as 20% of the signal — it's real gradient information, but the decoder (your friend's brain) discards it entirely. The tangent-projection fix is like telling your note-taker: only write down things that change which street I'm naming.
Ink color
Real property of the written directions that has zero effect on which route you drive
Radial gradient
Real coordinate change in raw network output that normalization discards before producing the final angle
Honest assessment
A clean theoretical contribution with solid empirical backing on tractable cases. The 72% synthetic misattribution number is the headline: it proves the problem is real and large, not edge-case. Real-data gains (44% on gaze, 14.1° on rotation) are meaningful. The scope is narrow — only fixed geometric decoders, only post-hoc gradient methods — but within that scope, this is likely correct and practically useful. The paper's honest null result on LayerCAM-quaternion and its explicit caveat that invariance alone is insufficient both increase credibility. Main risk: if nobody integrates this into XAI libraries, it stays a nice paper that practitioners never encounter.
What Is CLAIMS?
70
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
4/5
Architecture
4/5
Integrity
3/5
Milestone
3/5
Successor
3/5
What is this paper actually committing to?
Real but specialized: radial contamination in geometric-decoder attribution is a genuine bug nobody formally characterized before. The 72% misattribution on synthetic tasks makes the problem concrete, not theoretical.
The field fight
Should attribution methods explain raw network outputs or the final post-decoder prediction?
Side A
Attribute to raw outputs; the decoder is a fixed function and doesn't need explanation
Held by: Standard Grad-CAM, vanilla Integrated Gradients, most XAI library defaults
Side B
Attribution must respect the decoder's geometry; raw-output attribution explains things the network doesn't actually predict
Held by: This paper, prior work on invariant explanations
Milestone tracker
Unlocks: Trustworthy attribution for robotics manipulation, autonomous driving pose estimation, and medical imaging orientation tasks
Current
44%
deletion gain
tangent Grad-CAM on gaze
Next
SE(3)
decoder family
coupled rotation-translation
~1-2 years; requires larger Jacobian computation and articulated-pose benchmarks
Verified Facts (6)
Ambient attribution assigns up to 72% of its mass to an irrelevant region on synthetic tasks
Tangent Grad-CAM produces 44% greater prediction displacement under 10% pixel deletion on MPIIGaze validation data
Full differential improves mean deletion displacement by 14.1 degrees over ambient coordinate sum on PASCAL3D+ with 6D rotation decoder
Full differential improves mean deletion displacement by 13.8 degrees over decoder-invariant scalar on PASCAL3D+
Two-polarity tangent LayerCAM exceeds ambient-sum LayerCAM on circular regression but no difference is detected on quaternion pose
Paper is under review
Practical Implications (4)
If you use Grad-CAM or Integrated Gradients on any network ending in normalization, arctan2, or quaternion decoding, your current explanations are contaminated — potentially majority-contaminated
The fix for normalization decoders is a rank-1 matrix operation on the Jacobian; implementation cost is trivial once you know to do it
Deletion metrics should be run alongside invariance checks — invariant attribution can still miss scale-sensitive inputs that genuinely drive predictions
XAI library maintainers (Captum, tf-explain) should consider adding decoder-aware attribution targets as a first-class option for geometric output spaces
More latest news
Read all