Imagine you're editing a massive surveillance footage archive. You could watch every frame, then decide what matters — or you could fast-forward through the boring hallways while they're still loading, keeping only the moments where something happens. Every existing whole-slide pathology language model does the equivalent of watching every frame first. SLICEChat asks: what if we started throwing away empty hallway footage during the initial scan, not after? The committed claim: by integrating progressive token pruning inside the slide encoder — not bolted on afterward — you can build a multimodal LLM for gigapixel pathology images that is both more accurate and more efficient than systems that compress only post-encoding. The core mechanism is a hybrid Mamba-Transformer architecture where Mamba layers handle cheap long-range sequence propagation and Transformer layers handle the expensive global attention — but between stages, a language-supervised pruning step removes spatially coherent regions that the model judges low-utility. The keep-rate schedule is controlled, not learned end-to-end, which means you can tune the compression-accuracy tradeoff at inference time. On the ladder: SLICEChat posts 79.84% accuracy on the TCGA cohort of SlideBench VQA and 59.09% on BCNB, outperforming prior slide-level pathology MLLMs. It also achieves the highest overall WSI-Bench metrics among evaluated models. The paper claims competitive memory usage and inference latency, though the abstract doesn't provide exact GPU-hours or latency numbers versus specific baselines — a gap worth noting. The relevant prior art includes models like LongViLA and PathChat that process thousands of tokens but compress only after full encoding, leaving multimodal attention as the bottleneck. Architecturally, this sits at a specific intersection: Mamba (state-space models for linear-time sequence processing) married to Transformer attention layers (quadratic but preserving global interaction), with the twist being that the pruning happens between stages rather than at the output. The pruning itself is region-aware and language-supervised — meaning the model uses the downstream language task signal to decide which spatial regions to keep. This is a meaningful design choice: it couples the compression to the task rather than treating it as a generic dimensionality reduction. The integrity picture is mixed but reasonable for a first-showing paper. SlideBench VQA and WSI-Bench are community benchmarks, not cherry-picked tasks. Code is released on GitHub, which is the strongest single integrity signal in ML today. However, there's no independent replication, no ablation numbers in the abstract separating the contribution of Mamba layers versus the pruning schedule versus the language-supervised selection, and no pre-registration. The comparison set of 'prior slide-level pathology MLLMs' needs scrutiny — this is a young subfield and baselines may not be the strongest possible classical or non-MLLM alternatives. The milestone to watch is whether in-encoder pruning generalizes beyond VQA to harder clinical tasks: survival prediction, treatment response, molecular subtyping from morphology. The 79.84% TCGA VQA accuracy is encouraging but VQA is a relatively forgiving evaluation. Pushing to 85%+ on TCGA VQA while maintaining the latency advantage would be a strong signal. More importantly, demonstrating that the pruned representations preserve clinically relevant spatial features — not just VQA-relevant ones — is the real unlock. The obvious experiment the authors didn't run: end-to-end learned keep-rate schedules versus their controlled schedule, and a direct wall-clock comparison against a Transformer-only baseline with equivalent parameter count. My read is (a) — compute budget. Training multiple schedule variants on gigapixel images is expensive, and this is a first paper establishing the paradigm. The next paper will almost certainly include schedule ablations and harder downstream tasks.
