Imagine a group project where every team member is allowed to veto the final report. One person writes the theory, another designs the experiment, a third checks the math, and a fourth looks at the data with fresh eyes. If anyone spots a problem — a shaky assumption, a drifting instrument, a conclusion that outruns the evidence — the whole team stops, revises, and re-runs. No one gets to steamroll the group into publishing a bad result. That is the core mechanism of this paper: not a single AI doing science, but multiple LLM-based agents that peer-review each other in real time, with the authority to halt or redirect an investigation. The committed claim: collaborating LLM agents can autonomously select a research question, derive a theoretical result, design and execute a physical experiment on nitrogen-vacancy (NV) center spin ensembles in diamond, detect when their own data is compromised, and revise the protocol — all without a human in the loop relaxing the acceptance bar. This is not a simulation-only demonstration. The agents drove real microwave pulse sequences on real hardware. The experiment itself is a clean test case. The agents investigated the minimum number of calibration settings needed to predict responses of NV spin ensembles to a defined family of microwave pulse sequences. They derived the answer theoretically, checked it computationally, then designed experiments to distinguish competing predictions. The first run looked good — until repeated reference measurements revealed signal drift during data collection. The agents flagged the result as inconclusive, revised the measurement protocol, and re-ran. The second experiment passed their criteria and confirmed the theoretical prediction. The signal-drift catch is the headline result: the system demonstrated the kind of self-skepticism that most autonomous AI demos conspicuously lack. Architecturally, the system uses a multi-agent framework built on large language models — the paper does not specify which LLM backbone, which is a notable gap. Agents are assigned distinct roles (question generation, theory, experiment design, data analysis, peer review) and communicate through structured protocols. The key design choice is adversarial: agents can reject each other's conclusions and force re-investigation. This is closer to a multi-agent debate architecture than to a monolithic ReAct loop. The hardware side is an NV-center spin ensemble setup in diamond, controlled via microwave pulse sequences — a well-characterized quantum physics platform. On integrity, this paper earns real marks for running a physical experiment and honestly reporting a failed first attempt. The agents didn't cherry-pick: they caught the drift, marked the result inconclusive, and re-ran. But the validation is still a single experimental system (NV centers in diamond), a single research question, and no independent replication. The LLM backbone is unspecified, making reproducibility harder. Code is available on GitHub, which helps. The theoretical derivation was checked computationally by the agents themselves — useful but not independent verification. The milestone question is where the gap between demo and autonomous lab becomes clear. This paper demonstrates one full research cycle on one well-understood physical system. The next concrete milestone would be running multiple independent research questions across different experimental platforms — say, three distinct physics setups — without human intervention, and having the results independently replicated. We are at one system, one question today. The path to a truly autonomous research lab that a PI could trust with a budget and a semester is long. The obvious next experiment the authors did not run: applying the same multi-agent framework to a genuinely unknown research question — one where the theoretical answer is not already known to the human supervisors. Everything demonstrated here is on territory where humans can check the agents' homework. The honest read is that this is the correct scientific approach for a first paper — you validate the method on known ground before trusting it on unknown ground — but it also means the hardest test (open-ended discovery) remains unrun. Likely saving it for the next paper, not hiding a failure.
