You know how a kid who has only ever seen dogs and cats separately can still understand the sentence "the dog and the cat sat down" — even though they've never encountered that exact pairing? Now imagine a harder version: the kid has only ever seen "the dog and the cat" (same type joined), but you ask them to parse "happy and with enthusiasm" (adjective conjoined with a prepositional phrase — different types). Can they handle it? This paper says yes, and uses GPT-2 as the kid. The committed claim: language models do NOT need direct exposure to unlike coordination — conjunctions joining syntactically different categories — to learn it. Luo and Steinert-Threlkeld train GPT-2 from scratch on corpora from which every instance of unlike coordination has been surgically removed using their Filtered-Corpus Training (FiCT) method. The filtered models generalize to unlike coordination anyway, matching unfiltered baselines on both perplexity and grammaticality judgments. This matters because theoretical linguistics has fought for decades over whether coordination requires same-category constituents. The "Law of Coordination of Likes" says yes. Natural language says otherwise — sentences like "Pat is a Republican and proud of it" (NP + AP) are grammatical and common. The question is whether learning these patterns requires seeing them, or whether they fall out of more general compositional machinery. This paper lands firmly on the "falls out" side. The architecture is straightforward: GPT-2 small, trained from scratch on filtered vs. unfiltered English corpora. The interesting engineering is in FiCT itself — the corpus filtering pipeline that identifies and removes unlike coordinations while preserving the rest of the training distribution. The analyses go deeper than just perplexity: the authors probe internal representations and find two mechanisms at work. First, models treat unlike conjuncts as belonging to similar structural categories (a kind of representational coercion). Second, models deploy something akin to syntactic deletion — processing "Pat is a Republican and proud of it" as if it contains an elided copy of the predicate structure. The integrity picture is solid for a computational linguistics paper. The comparison is fair: filtered vs. unfiltered models trained on the same base corpus, evaluated on the same test sets. Six tables and two figures across 13 pages suggest thorough reporting. The baseline is the right one — the unfiltered GPT-2 trained under identical conditions. The result is a negative one (exposure is NOT necessary), which is harder to cherry-pick than a positive result. The main integrity question is whether FiCT's filtering is truly complete — if any unlike coordinations leak through, the whole result weakens. The milestone here is conceptual rather than numeric. The field needs to establish whether this result scales: does it hold for larger models? For more languages? For more exotic coordination types? The immediate next number to watch is coverage — what percentage of unlike coordination types does FiCT successfully filter, and does the generalization hold when you test on the rarest types rather than the most common ones? The obvious experiment the authors didn't run: testing on a larger model (GPT-2 medium or large) or a different architecture entirely (an LSTM, a state-space model). If unlike coordination emerges from compositional generalization in GPT-2 small, does it emerge MORE reliably in larger models, or is there a U-shaped curve? My read: this is (c) — they're saving the scaling story for the next paper. The TACL submission is already clean with GPT-2 small, and scaling adds complexity without changing the core claim.
