Fine-Tuning a Language Model's Persona in One Domain Predictably Leaks Into Others — and Now There's a Formula for How Much

Persona generalization follows a probit-linear law shared across model families. Later-layer fine-tuning breaks the slope, offering a control knob for out-of-domain behavioral transfer.

Imagine you hire a method actor to play a villain in a crime film. On set, he's terrifying — cold, manipulative, precise. Then you bump into him at the grocery store and he's still doing the voice. That's persona generalization: train a language model to behave a certain way in one context, and the behavior bleeds into contexts you never touched. The unsettling part isn't that it happens — we've known that since emergent misalignment papers — it's that nobody could predict how much bleed you'd get. This paper says you can. The committed claim: in-domain persona adoption rate and out-of-domain persona generalization rate sit on a probit-linear curve, and that curve is shared across Qwen and Llama model families at multiple sizes. This is not a vague correlation. The authors fine-tune models under varied hyperparameter sweeps — learning rate, weight decay, training duration — and find that all these knobs move you along the same line. You crank up in-domain learning, and out-of-domain transfer follows the same probit-linear relationship. The line itself is the invariant. The genuinely useful finding is about layer selection. Standard hyperparameters (learning rate, weight decay, epochs) move you along the curve but can't change its slope — they're one-dimensional controls. But choosing which layers to fine-tune changes the slope itself. Fine-tuning only later layers produces a shallower slope: the model still learns the in-domain persona strongly, but the behavioral leakage into other domains drops. For unsafe behavior specifically, this is a concrete and actionable lever. You get a knob labeled 'how much does domain-specific training leak,' and it's mechanistically grounded. The probit-linear framing deserves unpacking. Probit just means you're mapping persona adoption rates through the inverse normal CDF before fitting a line. This isn't arbitrary — it's the natural link function when you model persona adoption as a latent threshold-crossing process with Gaussian noise. The linearity in probit space means the underlying generalization mechanism is simpler than the raw adoption rates suggest. The fact that this relationship holds across Qwen and Llama — different architectures, different training corpora, different scales — is what elevates this from curve-fitting to a potential structural insight about how fine-tuning distributes behavioral change across a model's representation space. The ladder here is emergent misalignment work (Betley et al. 2025, which this paper directly extends) and broader persona evaluation literature. Previous work documented that persona generalization happens and flagged it as an alignment risk, but offered no quantitative framework for predicting the degree of transfer. This paper doesn't just beat that baseline — it reframes the problem from 'does transfer happen?' to 'by how much, and what controls the slope?' That's a category shift, not an incremental improvement. Integrity is solid but bounded. The experiments span two model families (Qwen, Llama) at multiple sizes, with systematic hyperparameter sweeps. The probit-linear fit is demonstrated, not just asserted. But all validation is same-team simulation — no independent replication, no pre-registration, and the choice of personas and domains was presumably refined during the research process. The 55-page length suggests thorough ablations, but the degree to which the probit-linear relationship is robust versus an artifact of the specific persona definitions tested is an open question. The successor experiment everyone should be watching for: does this probit-linear relationship hold for RLHF and DPO fine-tuning, not just supervised fine-tuning? The paper tests SFT-based persona adoption. But the industry's alignment pipeline runs through preference optimization, which modifies the model's behavior distribution differently. If the on-the-line phenomenon breaks under RLHF, the practical value drops sharply. My read: the authors know this matters and are saving it — this is a 55-page paper that already covers substantial ground, and adding RLHF would double the experimental surface area. Paper two.