Imagine you're hiring for a company, but instead of one interviewer picking candidates, you use a panel. Each interviewer sees different strengths in different applicants. The panel's consensus picks better hires than any single interviewer — and the disagreements between interviewers actually tell you something useful about what each hire is good at. That's Multi-View MoE: replace the single gating router in a sparse mixture-of-experts model with multiple independent routers, aggregate their votes, and then use the pattern of agreement and disagreement to shape each expert's input. The committed claim: multiple independently initialized routers develop differentiated expert preferences during training, and their aggregated signal produces better expert selection AND better expert computation than a single router — at zero additional expert FLOPs, zero additional all-to-all communication, same active-expert count. This is not a new expert architecture or a new training recipe. It's a surgical intervention on the routing mechanism that keeps the inference budget fixed. The paper diagnoses a real and underappreciated problem. When the authors evaluated all experts densely (running every expert on every token and measuring utility), they found that the single-router rankings and the ground-truth utility rankings showed weak rank correlation — especially in middle and deep layers. This is the core motivation: the router is a bottleneck not because it's too small, but because a single linear projection from the token embedding is an informationally thin signal for choosing among dozens of experts. Multi-Router aggregates sigmoid scores from multiple routers, letting experts that are strongly favored by one router OR jointly supported by several survive selection. The rank correlation between router scores and evaluated expert utility improves by 8.1% globally and approximately 58% in the worst-aligned layer. The second move — Multi-View — is more interesting architecturally. Instead of just using the router scores for selection, the method reuses each selected expert's relative scores across routers to mix learned latent views into that expert's input. Each router's preference pattern becomes a weighting over a set of learned view vectors, producing a per-expert, per-token input modulation. The expert still runs one forward pass, but its input is now conditioned on how and why it was selected. Controlled mixing interventions confirm the model exploits these input differences in ways that depend on both the expert identity and the token. The experimental setup is a 24-layer, 10B-parameter (1B active) model trained on 708B tokens, evaluated on a nine-task downstream mean. Full Multi-View MoE gains 1.18 percentage points over the baseline. Multi-Router alone gains 0.6 points. These are meaningful numbers at this scale — not transformative, but solidly positive for a zero-cost architectural change. The ladder here is the standard single-router top-k MoE, which is the dominant paradigm in deployed systems (Mixtral, DeepSeek-MoE, Switch Transformer). The paper does not compare against other multi-router proposals or auxiliary-loss routing schemes in detail, which leaves the ladder incomplete. The integrity picture is mixed. The evaluation uses a nine-task downstream benchmark suite, which is reasonable but not pre-registered. The rank-correlation analysis between router scores and dense expert utility is a genuinely useful diagnostic that most routing papers skip — it's the paper's strongest methodological contribution. However, the training is on a single model size (10B-A1B) at a single token budget (708B), with no scaling curve. Code and data availability are not stated. The validation is entirely internal: same team, same training infrastructure, same evaluation pipeline. The milestone question is about scaling. The demonstrated gain is at 10B-A1B on 708B tokens. The next number that matters is whether the gain holds or grows at 70B+ parameters with 200B+ active, where routing failures become more costly and expert specialization deepens. If the rank-correlation improvement scales, this becomes a default component of MoE training stacks. If it saturates at 10B, it's a nice trick for mid-scale models. The authors did not run a scaling experiment — most likely a compute budget constraint given the Baidu affiliation and infrastructure cost of 70B+ MoE training. This is the obvious successor experiment.
