Imagine you're running a brainstorming session. The traditional approach is to have a few expensive consultants each write a long memo, then laboriously combine their ideas in a new memo, round after round. SwarmEvolve's approach is more like handing hundreds of interns Post-it notes, letting them cluster by topic, having a manager glance over each cluster's combined notes, and picking the most distinctive ideas — all without anyone ever writing a full sentence. The "Post-it notes" are KV cache states; the "glance" is latent-space summarization; the "distinctiveness filter" is cosine distance between hidden-state vectors. The committed claim: an 8B open-weight model (Qwen3 8B), running hundreds of agents per round that never decode to text, can match or beat the best-known solutions on 21 mathematical discovery and scientific computing problems — including solutions originally found by AlphaEvolve using frontier LLMs — while reaching those scores in 3-8 minutes instead of 60. This is not a marginal speedup on a toy benchmark. It is a structural argument that latent-space communication between agent swarms is cheaper and more effective than text-mediated evolutionary search. The architecture is a genuine novelty in LLM-guided evolutionary optimization. Prior frameworks like FunSearch, OpenELM, and AlphaEvolve treat LLMs as black-box text generators: produce code, evaluate, select, repeat. SwarmEvolve instead keeps agents in latent space, passing KV caches rather than decoded strings. Crossover happens by concatenating KV caches from swarm members and feeding them to a summarizer agent — a form of implicit recombination that avoids the information bottleneck of text serialization. A novelty filter operates directly on hidden-state vectors via distance metrics, maintaining population diversity without needing to parse or compare generated programs textually. Each swarm studies a problem from a different angle, and the per-agent cost is low because no decoding pass is required. The ladder position is strong but requires careful reading. On the 21-problem benchmark suite, SwarmEvolve achieves the highest average score across problems and reaches the best scores of competing SOTA frameworks (FunSearch, OpenELM, ReEvo, and critically AlphaEvolve) at a median of 3-8 minutes versus 60 minutes. On several specific problems, SwarmEvolve with Qwen3 8B actually improves on solutions AlphaEvolve found with frontier models. That last claim is the headline: an 8B model beating frontier-model solutions is an efficiency result, not just a speed result. But the comparison to AlphaEvolve deserves scrutiny — AlphaEvolve's published results are on specific problem instances, and whether the benchmark overlap is complete and fair matters. Integrity sits in the mid-range for this kind of systems paper. The 21 problems span mathematical discovery and scientific computing, which is a reasonably broad test bed. The comparison to multiple named SOTA frameworks is good practice. However, this is self-evaluated: the same team ran all baselines, chose the problem set, and reported the timing comparisons. No independent replication exists yet. The timing comparison (3-8 min vs 60 min) is striking but depends on hardware configuration, which must be scrutinized in the full paper. The claim of improving on AlphaEvolve solutions specifically needs independent verification, since AlphaEvolve's original results used different hardware and possibly different problem parameterizations. The milestone to watch is whether latent-space agent communication scales beyond program search into broader domains — theorem proving, chip design, drug discovery pipelines — where the search space is similarly combinatorial but the fitness landscape is harder to evaluate cheaply. The current result at 21 problems with an 8B model is the proof of concept. The next concrete target would be demonstrating latent-swarm search on problems requiring 70B+ equivalent reasoning depth, or on benchmarks with 100+ problems, to prove the approach doesn't plateau. The obvious experiment not run: scaling to larger base models (70B+) to see if latent-space swarms compound the gains or hit diminishing returns. The honest read is probably (c) — they're saving it. The 8B result is already a strong headline precisely because it beats frontier models; showing 70B results would either confirm the trend (nice but expected) or reveal a ceiling (damaging). Running Qwen3 8B keeps the "small model beats big model" narrative clean. The other missing experiment is an ablation isolating the KV-cache crossover mechanism from the novelty filter — both are novel, and we don't know which drives the gains.
