A Memory That Knows What to Forget: MaxIM Uses Information Theory to Teach LLMs How to Summarize Under Strict Budgets

MaxIM reframes incremental summarization as a capacity-constrained information-maximization problem, using dense MI-based rewards to dodge RL's credit assignment nightmare. NeurIPS 2026 accept.

Imagine you're a court stenographer, but your notebook only has 50 pages — and the trial runs for months. You can't just write smaller; you have to decide, in real time, which testimony to keep and which to overwrite. The nightmare isn't the writing — it's that you won't know which testimony mattered until the verdict, months later. That delayed payoff is why standard RL chokes on memory management: the reward signal arrives too late and too sparse for the agent to figure out which earlier summarization decision was the good one. MaxIM attacks this directly. The core claim: you can turn the credit assignment problem into a dense, step-wise reward signal by treating each summarization step as a channel with bounded capacity, then maximizing the mutual information between the summary and the observed history at every step — not just at the end. The theoretical grounding is a value suboptimality bound showing that bounding sequential information loss is equivalent to maximizing a variational lower bound on predictive sufficiency. In practice, this means the model gets a reward at each summarization step proportional to how well the current summary would let you reconstruct future task-relevant targets. The architecture leans on a parameterized asymmetric critic — a separate network that computes step-wise variational mutual information bounds. This is the load-bearing piece. The critic has access to the full history (asymmetric because the actor only sees the compressed summary), and it provides the dense reward shaping that makes RL tractable. The recursive consistency condition ensures summaries don't drift into hallucinated compression artifacts: each summary must maximize MI with the actual observed history, not just future-predictive utility. This is a variational information-bottleneck approach inside an RL loop, not a pure supervised or prompting strategy. Where does this land against baselines? The paper benchmarks on long-horizon scientific reading (multi-paper synthesis under token budgets) and multi-turn dialogue tasks. It reports outperformance against vanilla RL, supervised fine-tuning, and prompt-based summarization baselines on three axes: factual grounding (fewer hallucinations), comprehensive autorater scores, and downstream task utility. Critically, these gains hold across strict token budgets and extended horizons — the regime where naive approaches degrade fastest. The paper does not claim to beat human-preference-trained RLHF models head-to-head, but sidesteps the need for expensive human labels entirely. The integrity picture is reasonable for a NeurIPS accept. The benchmarks span two distinct domains (scientific reading, dialogue), which reduces cherry-picking risk. Autorater metrics plus downstream task utility is a stronger validation regime than autorater alone. However, the absence of human evaluation is a notable gap — autorater metrics and downstream utility are proxies, and the degree to which they correlate with human judgment on summarization quality is itself an open question. No pre-registration is mentioned, and code availability is not stated. The milestone to track: current results demonstrate the framework at the scale of scientific papers and multi-turn dialogues with strict token budgets (likely 512–2048 token summaries). The next meaningful threshold is applying this to truly unbounded interaction histories — months of agent-environment interaction, or lifelong conversational agents maintaining coherent memory over thousands of turns. That's probably 2–3 years out, gated on both compute and the availability of suitable long-horizon benchmarks. The real unlock would be an LLM agent that can operate over weeks of interaction without catastrophic forgetting or context-window hacks. The obvious experiment not run: scaling to frontier-sized models (70B+ parameters) and measuring whether the MI-based reward shaping remains tractable and beneficial at scale. The asymmetric critic's compute overhead likely grows with model size, and the variational bounds may loosen. My read: this is partly a compute budget constraint (Google DeepMind authors, but asymmetric critic training at 70B scale is expensive) and partly strategic — demonstrating the framework's conceptual contribution at moderate scale before the scaling paper.