Imagine a pickup basketball game. You take five excellent individual players and throw them on the court together. They're talented, but they trip over each other, duplicate effort, and nobody knows who takes the last shot. Now give them a coach who assigns roles — point guard, center, shooting guard — and suddenly the same five players look like a different team. The talent didn't change. The scaffolding did. That's the core mechanism of this paper. The committed claim: evolution of LLM multi-agent systems alone rarely helps; the social scaffolding — team composition and interdependence structure — is what drives performance gains of up to 25 points over a strong single agent evolved in isolation. AGORA (Agents Growing through Organization and Relational Arrangements) is a framework that independently varies two axes: who's on the team (composition) and how they relate (collaboration, conformity, or competition), tested across three evolution mechanisms and three task domains. The ladder matters here. The baseline is a single GPT-4-class agent allowed to self-evolve its own prompts and tool use — already a strong setup that recent papers have championed. AGORA's scaffolded teams beat this by up to 25 absolute points on web search, codebase understanding, and document QA. But here's the nuance: evolution without scaffolding barely moves the needle. The paper is explicit that naive self-evolution — the thing the field has been excited about — is near-useless without the right social structure. That's a deflating finding for the 'just let agents evolve' camp. Architecturally, this sits in the prompt-level meta-optimization family — agents rewrite their own system prompts, tool configurations, and collaboration protocols across iterative rounds. No weight updates, no fine-tuning. The evolution mechanisms are prompt mutation, role reassignment, and workflow restructuring. The interdependence structures (collaboration, conformity, competition) borrow directly from social psychology's scaffolding literature. The compute property this leans on is inference-time scaling: more structured LLM calls, not more parameters. The most interesting finding is emergent hierarchy. When scaffolding works, authority migrates to the most capable agent while others voluntarily reduce their role. The team self-organizes into a leader-supporter pattern, and critically, the emergent leader — having evolved within the team — outperforms the same model evolved alone. The team doesn't just pick a winner; it grows a better one. This echoes Vygotsky's zone of proximal development: agents achieve more within a social structure than they can alone, and they carry that capability forward. Integrity is mixed. Three task domains (web search, codebase understanding, document QA) provide breadth, and the 27 tables across 35 pages suggest thorough ablations. But the evaluation is entirely same-team simulation — the authors designed AGORA, ran AGORA, and scored AGORA. No independent replication, no pre-registration, and the benchmark selection appears post-hoc. The paper doesn't compare against other multi-agent frameworks like AutoGen or CrewAI in a head-to-head, which is the comparison the field actually needs. The strongest result (25-point gain) is a peak, not a mean — the average improvement across all configurations is likely much smaller, but the paper foregrounds the peak. The successor question is straightforward: scale to harder tasks with more agents and test whether the scaffolding patterns hold. The authors stop at three-domain evaluation with relatively small teams. The obvious next experiment is a 10+ agent team on a complex software engineering benchmark like SWE-bench. My read: they ran out of compute budget. Inference-time scaling with multiple GPT-4-class agents across iterative evolution rounds is expensive, and the combinatorial explosion of scaffolding configurations × evolution mechanisms × domains × team sizes gets costly fast. The paper's 27 tables already represent a substantial compute investment.
