Imagine you're estimating neighborhood crime rates by counting police cars parked at precinct headquarters. A precinct with 50 cars might serve three neighborhoods, but you'd have to guess how to split that 50 among them. If one precinct is physically located in a small neighborhood, that neighborhood suddenly looks like it has more cops per capita than anywhere in the city — maybe impossibly many. That's the core measurement problem this paper diagnoses in how researchers estimate local union membership across the United States. The committed claim: aggregating union-reported membership from federal LM filings to substate geographies — counties, commuting zones, congressional districts — is unreliable, and that unreliability is substantively consequential for downstream research. The Current Population Survey (CPS) is the gold standard for US union data but is designed for state-level reliability; below that, sample sizes collapse. Researchers have therefore turned to LM filings, where unions self-report their membership totals to the Department of Labor, geolocating each local by its filing address and summing membership within geographic boundaries. This paper asks whether that workaround actually works. The authors build a multilevel regression with poststratification (MrP) model on CPS microdata as their benchmark — a Bayesian hierarchical model that borrows strength across demographic and geographic cells to produce small-area estimates where raw CPS cell counts are too thin. They then validate LM-based density estimates against both raw CPS and MrP from state level on down. At the state level, all three measures are highly correlated. But at congressional-district, commuting-zone, and county levels, the LM-to-benchmark correlation roughly halves. The mechanism is what they call reporting "lumpiness": a single large local union files its entire membership at one address, dumping thousands of members into a single county that may not be where those members actually live or work. This produces union densities exceeding 100% in some geographies — an impossibility that flags a structural flaw, not an edge case. One natural objection is that LM filings exclude most public-sector unions (which file under different statutes). The authors test this directly and find it explains only a small share of the divergence. The lumpiness problem is the dominant driver. They also show that the choice of measure is not just an academic nit-pick: in a standard commuting-zone "China Shock" regression (the Autor-Dorn-Hanson framework that has been enormously influential in trade economics), swapping the LM-based density measure for the MrP-based measure changes the import-exposure coefficient enough to alter its magnitude, statistical significance, and sign. That's not noise — that's the kind of measurement artifact that can reverse a published finding. The MrP benchmark itself deserves scrutiny. MrP is well-validated in political science (election forecasting, opinion estimation) but less battle-tested for labor economics outcomes. The authors defend it carefully — showing it recovers known state-level patterns and produces sensible demographic gradients — but the ground truth for substate union density simply does not exist at the precision needed for a definitive validation. They are comparing one imperfect measure against a more principled but still model-dependent alternative, which is honest but means the critique is stronger than the replacement. The paper's architecture is straightforward applied statistics: Bayesian multilevel logistic regression (MrP), geographic concordance files for mapping CPS respondents and LM locals to consistent boundaries, and standard regression diagnostics for the China Shock replication. No deep learning, no exotic compute. The heavy lifting is in the data engineering — harmonizing CPS microdata across years, geocoding LM filings, handling boundary changes — and in the careful decomposition of where and why the measures diverge. The upshot is a clear warning to the quantitative labor and political economy literatures: if your regression relies on LM-based union density at the county or commuting-zone level, your results may be driven by measurement artifact rather than economic signal. The authors are careful to note that LM filings remain valuable for studying unions as organizations (structure, finances, governance) — just not for imputing where union members actually live.
