Imagine you're tuning a guitar. You tighten the G string, but the bridge flexes and the D string goes flat. Every guitarist knows this — adjusting one string changes the tension on all the others. This paper treats LLM alignment the same way: fine-tune a model to be 'honest,' and you've quietly shifted its behavior on 'curiosity,' 'obedience,' and 65 other values, in directions nobody asked for and nobody predicted from the value labels alone. The committed claim: the authors establish 'alignment generalization prediction' as a task — given that you fine-tune on value X, predict quantitatively how the model's behavior changes across 65 held-out values Y. They construct a 66×66 generalization matrix by training separate LoRA adapters for each of 66 values found in real alignment targets (Anthropic's, DeepSeek's, etc.) and evaluating each adapter across all other values. The core finding is that representations derived from model activations (how the model internally processes a value in context) predict this generalization matrix with correlation 0.45, while text-description-based representations — essentially reading the label and guessing from semantics — achieve only 0.05. The architecture is straightforward: LoRA fine-tuning of LLaMA-3-8B-Instruct on synthetic behavioral demonstrations for each value, with evaluation via a separate LLM judge scoring adherence to held-out values on 20-turn dialogues. The representational methods tested range from simple text embeddings of value descriptions, through sentence-BERT and LLM-generated elaborations, to activation-based probes that extract model internals when processing value-relevant scenarios. The activation methods — specifically, mean-pooling hidden states across value-demonstration prompts — are the clear winners. This is a supervised probing setup, not a mechanistic interpretability deep-dive, but it establishes that the information about how values will generalize IS present in the model's internal geometry. The ladder here is tricky because the task itself is new — there's no prior SOTA for 'alignment generalization prediction.' The relevant predecessors are Anthropic's work on model organisms, Durmus et al.'s persona-based evaluations, and the growing literature on 'alignment tax' and value conflict. The paper's contribution is less about beating a number and more about defining the measurement. The 0.45 correlation from activation-based methods is meaningful but far from predictive — you'd be wrong more than half the time using it alone. The 0.05 from description-based methods is the real headline: reading the labels tells you almost nothing about what will actually happen. Integrity has real strengths and real gaps. The generalization matrix is built from 66 × 66 = 4,356 evaluations, each involving 20-turn dialogues scored by an LLM judge (GPT-4o-mini). The judge-as-evaluator pattern introduces circularity — you're measuring alignment effects using another aligned model's judgments. The authors acknowledge this and show some robustness checks, but no human evaluation baseline is reported. The 66 values are drawn from real alignment targets, which grounds the selection, but the synthetic training data is GPT-4o-generated, adding another layer of model-evaluating-model. Code availability is not explicitly stated in the abstract. The practical punchline is the downstream finding: when the values in a multi-value alignment target are too similar (as measured by these representations), the resulting model is LESS robust. This is genuinely useful — it suggests alignment target designers should diversify their value sets, not just pile on synonyms for 'helpful.' The authors also present initial evidence for a model-independent value space, meaning the geometry of value generalization may transfer across model families. If that holds, it's a significant structural insight for the field. The obvious next experiment is scaling: does this generalization geometry hold for 70B+ models, for non-LLaMA families, and across different fine-tuning methods (full fine-tuning, RLHF, DPO)? The authors likely ran out of compute — 66 separate LoRA adapters times multiple model sizes gets expensive fast. The model-independence claim is shown only as 'initial evidence,' which reads as a preview of a follow-up paper. The deeper missing piece is causal: the activation representations PREDICT generalization, but the paper doesn't explain WHY certain values crosstalk. That's the hard mechanistic question this work sets up but doesn't attempt.
