Imagine you're grading a student's handwriting by whether the sentence is legible — pass or fail. You'd catch the kid who wrote nothing, but you'd miss the kid whose letters are technically readable yet formed with bizarre, wasteful pen strokes that will fall apart the moment the paper changes. That's the state of articulated-object manipulation evaluation today: binary task success tells you the door opened, but not whether the robot's commanded motion actually respected the door's hinge axis. This paper builds the handwriting-stroke analyzer. The committed claim: Constraint-Referenced Strategy (CRS) decomposes a robot's end-effector twist command into two scalar channels — progress along an object's kinematic joint axis and waste orthogonal to it — yielding a diagnostic signature that binary success rate cannot provide. Across 74 simulated articulated objects, the authors show that success rate registers three distinct transfer-failure modes as lower numbers but cannot distinguish them, while the two CRS channels give each failure mode a unique fingerprint. The mechanism is straightforward once you see it. Given a joint model (rotation axis for a hinge, translation axis for a prismatic joint), CRS projects the commanded twist onto that axis. The on-axis component measures useful work; the off-axis component measures wasted or potentially harmful force. A door-trained behavior-cloning policy that transfers to drawers succeeds in 59 of 110 episodes — a respectable-looking 54% — but its passing episodes command roughly 40× the off-axis rotation of a drawer-trained policy's passes (1.27 vs. 0.032 rad/s). Success rate sees two policies that sometimes open drawers; CRS sees one policy that brute-forces drawers open despite commanding wildly wrong rotations. The baseline ladder here is unconventional because CRS isn't competing with another metric on accuracy — it's competing with binary success rate on diagnostic power. The paper's strongest move is showing that three qualitatively different failure modes (wrong axis, wrong direction, excessive force) collapse into a single lower success number but separate cleanly in CRS space. There's no existing named metric that does this decomposition; the closest relatives are task-progress curves and constraint-violation penalties in motion planning, but neither produces the two-channel signature CRS offers. Integrity is mixed. Validation is entirely in simulation (74 objects from PartNet-Mobility), with no physical robot experiments. The robustness analysis is honest and specific: CRS verdicts hold under joint-axis estimation errors up to 30°, while absolute thresholds tolerate about 8°. But the method requires a known joint model — a non-trivial assumption in the real world — and the paper doesn't test what happens when the joint model is learned from noisy perception rather than ground-truth simulation data. The scripted controller baseline is derived from the same joint model, which introduces some circularity. The milestone question is practical: CRS on a physical robot with a learned joint model from RGB-D perception. The 30° robustness margin is encouraging — modern joint-axis estimators are often within 10-15° — but the gap between simulation ground truth and noisy real-world perception is where this metric will either prove its value or break. The authors don't report any physical experiments, and the honest read is that they ran out of scope rather than hiding failures; the sim-only validation is thorough enough that a real-robot follow-up is the obvious next paper, not a buried negative result. What makes this worth your time isn't a flashy SOTA number — it's a lens. If you work on robot manipulation, you've watched success rates hide policy pathologies. CRS gives you a decomposition that makes those pathologies visible. The limitation is that it only works for articulated objects with identifiable joint axes, and it requires that joint model as input. But within that scope, it's a clean, useful diagnostic tool that fills a genuine evaluation gap.
