Imagine you have a bilingual friend who speaks French and English fluently. You assume they store the concept of 'dog' in one mental slot — whether they hear 'dog' or read 'chien,' the same neuron fires. Now test that assumption: do they actually represent the voiced/voiceless distinction (the difference between 'b' and 'p') the same way when they hear it versus when they read it? That's what this paper does, except the bilingual friend is an audio language model that processes both speech waveforms and text tokens through a single decoder. The committed claim: audio language models do NOT generally represent distinctive phonological features (voicing, nasality, place of articulation, etc.) in aligned directions across their audio and text streams. The single exception is voicing in the two Qwen2.5-Omni models, and even that result barely survives multiple-testing correction. Everything else — 7 features, 6 models, 15 languages — is noise relative to a carefully constructed random-pairing baseline. The method is clean and worth understanding because it generalizes. For any minimal pair of phonemes differing in one feature (say, /b/ vs /p/ for voicing), take the vector offset between their mean representations in each stream. Average those offsets across all minimal pairs for that feature to get a 'feature direction' per stream. Then measure the cosine similarity between the audio-stream direction and the text-stream direction. The key move is comparing this cosine not against zero but against a reference distribution built from random phoneme pairings — because the two streams already share enough structure that arbitrary pairs show non-trivial cosine agreement. This reference-correction is what separates the paper from a naive 'look, the cosines are positive!' result. The reference baseline itself is revealing: it varies by a factor of seven across models, meaning some models have far more shared structure between streams than others, regardless of whether that structure tracks linguistically meaningful features. Model family (Qwen vs Gemma vs others) predicts cross-modal alignment far better than model size does. This is a genuinely useful finding for anyone building or evaluating multimodal architectures — scale alone won't buy you aligned representations. For voicing specifically, the paper finds one direction in audio across 14 languages in three of six models, with every language pair agreeing in direction in two of them. This is the strongest positive result, and it's narrow: one feature, one model family, and even then the effect is modest. The paper is honest about this, which is refreshing. The integrity story is solid for an interpretability paper. The baseline construction is the right one — comparing against random pairings rather than zero avoids the most common inflation trap in representation-probing work. Correction for multiple testing (across 7 features × 6 models × 15 languages) is applied honestly, and almost everything washes out. No code release is mentioned, which is a gap, but the method is simple enough to reimplement. The real takeaway isn't about voicing — it's about the negative result. If you assumed that passing speech and text through a shared decoder would produce shared phonological geometry, this paper says: mostly no. That matters for anyone building audio LMs and hoping for emergent cross-modal abstraction. The decoder finds convenient representations for each stream, but those representations aren't converging on the same phonological axes. The architecture is shared; the geometry is not.
