Imagine you learned to drive on the left side of the road, then moved to a country where everyone drives on the right. For years, your left-side instincts bleed through — you glance the wrong way at intersections, you drift slightly in tight turns. Your driving isn't broken, but it carries a ghost of the old system. This paper asks: do bilingual language models carry the same kind of ghost? And if so, does that ghost match the one inside a real human reader? The committed claim: bilingual LMs trained on English plus a reader's specific first language (L1) predict that reader's L2 English reading times better than either a monolingual English model or a bilingual model trained on a mismatched L1. This is not a new architecture or a new training method — it's an empirical finding about what bilingual models have already learned to represent. The authors test this across 12 diverse L1 backgrounds using the MECO L2 eye-tracking corpus, which records how non-native speakers read English sentences. The key measure is surprisal — how unexpected each word is according to the model — and whether matching the L1 makes that surprisal a better predictor of actual gaze behavior. The ladder here is monolingual English GPT-2 surprisal, the standard baseline in reading-time prediction since Frank (2013) and successors. The bilingual models are GPT-2 variants trained from scratch on balanced English + L1 corpora. Matched-L1 bilingual models outperform the monolingual baseline, and critically, they outperform mismatched-L1 bilingual models — this is the control that rules out the explanation that any bilingual training helps. The effect is concentrated in late-stage eye-tracking measures (total reading time, regression path duration), not early fixation measures. This matters because psycholinguistics associates late measures with higher-level reanalysis and integration, exactly where L1 transfer theories predict interference would show up. Architecturally, these are standard GPT-2 small models (117M parameters) trained from scratch on ~100M tokens per language, using a shared BPE vocabulary. The method is deliberately simple — the question isn't whether a fancy architecture can do this, but whether the basic statistical structure of co-training on two languages produces transfer patterns that mirror human cross-linguistic influence. The shared vocabulary is load-bearing: it forces the model to develop representations where L1 and English tokens interact, which is the mechanism the authors argue captures cross-linguistic transfer. The integrity picture is mixed but honest. The MECO L2 corpus is a real, published, multi-site eye-tracking dataset — not a synthetic benchmark. The 12 L1 backgrounds provide genuine diversity (Estonian, Finnish, Greek, Hebrew, Japanese, Korean, Norwegian, Russian, Spanish, German, Dutch, Turkish). The matched-vs-mismatched comparison is the right control. But the models are small (117M params, ~100M tokens per language), the effect sizes are modest, code and data availability aren't explicitly confirmed in the abstract, and this is under review with no independent replication. The finding that script overlap modulates the effect (stronger L1 transfer when L1 uses a different script from English) adds a nice falsifiable prediction, but the proficiency interaction — peaking at intermediate proficiency — could reflect either a real cognitive phenomenon or a statistical artifact of binning. The milestone question is whether bilingual LM surprisal can move from a diagnostic tool (confirming that L1 transfer exists in reading) to a predictive one (e.g., personalizing reading difficulty estimates for L2 learners, or diagnosing which L1 backgrounds will struggle with which English constructions). The current work demonstrates the alignment between model and human, but practical applications need larger models, more fine-grained proficiency data, and validation on reading tasks beyond natural sentences. The obvious next experiment the authors didn't run: scaling to larger models (GPT-2 medium/large, or modern architectures like Llama) to see whether the matched-L1 advantage persists, shrinks, or grows with model capacity. My honest read is (a) — compute constraints. Training 12+ bilingual GPT-2 models from scratch is already expensive; doing it at 7B scale across 12 languages is a substantial resource commitment for a psycholinguistics lab. If the effect vanishes at scale, the finding is less about what models learn and more about what small models fail to learn — an important distinction the authors haven't resolved.
