
Imagine you're playing poker and one player at the table can see everyone's cards — but only uses that information selectively, folding when the stakes are low and cheating only when the pot is big enough to matter. That's the mechanism this paper uncovers in figure skating judging: nationalistic bias isn't a constant thumb on the scale, it's a strategic instrument deployed precisely when it can change outcomes. Liu and Shen's committed claim is twofold. First, judges award a measurable compatriot premium — inflated scores for skaters from their own country. Second, and more novel, they find a targeted penalty against the compatriot's closest rivals, one that scales with competitive stakes. The penalty grows when the compatriot has a realistic shot at a medal and fades once she's effectively eliminated. This isn't noise or taste — it's game theory with scorecards. The identification strategy leans on a clever natural experiment: the random draw of skating order. Because judges evaluate sequentially within a competition, the compatriot premium can be tracked as it decays along the start order — early slots show stronger bias than late slots, consistent with strategic front-loading. Before the 2022/23 season (when ISU reformed its judging system), the premium also rose when close rivals had their own national judges on the panel, suggesting judges were responding to perceived counter-bias from opponents. The architecture is panel fixed-effects regression with judge-skater pair variation, exploiting within-competition randomization for causal traction. The ladder here is the extensive literature on home-team bias and nationalistic scoring in subjective sports, particularly the work of Zitzewitz (2006, 2014) on skating and Emerson et al. on gymnastics. Most prior work focused on the compatriot premium alone. This paper's contribution is the rival penalty and its strategic modulation — that's the genuine advance. The counterfactual simulations showing bias can flip close medal outcomes give the findings teeth beyond coefficient tables. Integrity is reasonable but has limits. The data is observational — rich and multi-season, but there's no randomized assignment of judges to panels (only skating order is randomized). The authors use within-competition variation and panel composition shifts as identifying variation, which is solid but not bulletproof. The pre-2022/23 vs. post reform comparison is a useful quasi-experiment. No pre-registration, no independent replication, no public code mentioned in the abstract — standard for applied economics but worth flagging. The milestone question is practical: at what threshold does strategic bias become detectable enough for real-time intervention? The paper shows bias matters in close competitions but doesn't propose a monitoring algorithm. The next concrete step is a detection system that flags anomalous scoring patterns in real time — moving from retrospective proof to prospective prevention. The ISU's 2022/23 reforms are a natural policy experiment; the obvious next study is a clean diff-in-diff measuring whether the reform actually killed the rival penalty or just pushed it underground. The experiment the authors didn't run — and almost certainly want to — is a full structural model of judge utility that jointly estimates the compatriot premium, rival penalty, and risk of detection as a strategic optimization problem. That would let you simulate rule changes before implementing them. My read: this is being saved for the next paper, since the reduced-form evidence here is the necessary foundation.
The analogy
Imagine a poker player who can see everyone's hand but only cheats when the pot is big enough to justify the risk. Figure skating judges don't apply a flat bias — they strategically inflate compatriots and penalize rivals only when medal contention makes the manipulation worth it.
Poker cheat
A player who sees all cards but only exploits the information when the pot size justifies the detection risk
Strategic judge
A skating judge who modulates compatriot premium and rival penalty based on real-time medal contention stakes
Honest assessment
A genuinely clever applied micro paper that advances the bias literature from 'judges favor compatriots' to 'judges strategically punish competitors when it matters.' The identification is smart but observational — no randomized experiment, no pre-registration, no public code. The rival penalty finding is the real contribution; the compatriot premium replication is necessary but not new. Most useful for sports governance designers and mechanism design researchers. The structural model this paper is begging for will be the bigger paper — this one lays the foundation.
What Is CLAIMS?
67
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
3/5
Integrity
3/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Real advance over prior work. Compatriot premium is well-documented; the rival penalty and its strategic modulation by competitive stakes is genuinely new to this literature.
The field fight
Is nationalistic bias in expert judging a fixed preference (taste) or a strategic instrument modulated by competitive incentives?
Side A
Bias is a fixed compatriot premium — judges consistently favor their own regardless of stakes
Held by: Zitzewitz 2006, early home-bias literature
Side B
Bias is strategic — judges modulate favoritism based on competitive context and detection risk
Held by: This paper, game-theoretic judging models
Milestone tracker
Unlocks: Prospective bias prevention during live ISU competitions, not just retrospective proof
Current
2
bias channels
premium + rival penalty identified
Next
1
real-time detector
live anomaly flagging system
~1-2 post-reform seasons for diff-in-diff; structural model 2-3 years
Verified Facts (5)
Evidence of a strategic compatriot premium and a targeted penalty on the compatriot's close rivals
The premium falls along a randomly drawn start order
Before 2022/23, premium rises when close rivals have their own judges on the panel
The penalty grows with the compatriot's placement chances and fades once she is out of contention
A counterfactual analysis shows that these biases can shape close competitions
Practical Implications (4)
ISU and other subjective-sport governing bodies should monitor not just compatriot score inflation but anomalous score depression of close rivals
The 2022/23 reform is a live natural experiment — organizations should be collecting data now for formal evaluation
Real-time statistical monitoring of judge scoring patterns during competitions is technically feasible and this paper provides the theoretical basis for what to flag
Any expert panel system (grants, hiring, competitions) where panelists have ties to candidates should consider whether rival-penalization is a plausible strategic channel
More latest news
Read all