Imagine you're trying to rearrange a crowded parking lot where every car must reach a specific spot but no two cars can occupy the same space at the same time. Now imagine instead of a human traffic controller, you hand the job to a tireless intern who writes a new set of traffic rules, watches the resulting chaos on camera, rewrites the rules, and repeats — hundreds of times — until the lot flows smoothly. That intern is an LLM coding agent, the parking lot is a multi-agent pathfinding (MAPF) grid, and the rules it writes are actual executable Python algorithms. This paper's committed claim: policy search directly in code space, where LLM-based coding agents iteratively propose, implement, evaluate, and refine coordination algorithms, is a viable third path between hand-crafted algorithm design and opaque reinforcement learning — and it produces solutions that are both interpretable and dramatically better than human-engineered baselines. The results land hard. On a challenging map from the 2024 League of Robot Runners (LoRR) competition, a two-day search discovered a policy that exceeds the stronger locally reproduced competition entry by 35.0% on the densest instance (1000 agents). In simulated real-world warehouses with irregular lanes, continuous robot geometry, and asynchronous motion, a week-long search found an entirely new class of MAPF algorithm that outperforms a calibrated proprietary industrial solution by 58.9% in throughput. These aren't marginal gains on toy problems — the warehouse scenario involves the kind of messy, continuous-space, asynchronous physics that typically breaks academic MAPF methods. Architecturally, this is not reinforcement learning and not classical algorithm design. It's evolutionary program synthesis: the LLM coding agent operates in a loop of propose → implement → simulate → diagnose → refine, guided by simulation feedback and explicit correctness verification. The search space is source code itself — the agent writes Python functions that implement coordination policies, runs them against a simulator, reads the logs, and writes a better version. The human role is directorial: defining the evaluation harness, setting correctness criteria, and occasionally steering the search. The compute substrate is the LLM itself (state-of-the-art coding agents, likely Claude or GPT-4-class), plus simulation infrastructure. The key structural bet is that code is a better search space than weight vectors because it's interpretable and verifiable. Integrity is mixed but honest. The LoRR competition benchmark is a real community challenge, and the authors compare against a locally reproduced version of the competition winner — not a straw man. The warehouse scenario compares against a calibrated proprietary solution, which is harder to verify externally but reflects genuine industrial practice. Crucially, the authors prove that their warehouse algorithm is collision-free and completes every accepted goal in finite time, adding formal verification on top of empirical results. The weak spots: no pre-registration, no independent replication, and the proprietary baseline is inherently opaque. The competition map results generalize to unseen instances, which is a meaningful robustness check. The milestone question is where this gets interesting for the field. The paper demonstrates that LLM-driven code search can discover algorithms humans haven't found — not just optimize parameters within a known algorithm family, but produce structurally novel coordination schemes. The next concrete threshold: can this approach scale to 5,000+ agents in real-time warehouse settings, and can the discovered algorithms transfer to physical robots with sensor noise and actuator delay? The gap between simulation and deployment is the load-bearing unknown. The obvious experiment the authors didn't run: ablating the human-in-the-loop component to measure how much of the performance gain comes from the LLM's code generation versus human steering. The two-day and week-long search timelines suggest heavy human involvement in defining evaluation criteria and guiding the search direction. My read: they're saving the fully autonomous version for the next paper, because demonstrating human-directed search is the easier sell and the autonomous version probably doesn't work as cleanly yet. The other missing piece is a head-to-head against RL-based MAPF methods (like PRIMAL, SCRIMP) on the same benchmarks — the paper frames code search as an alternative to RL but doesn't directly compare.
