Imagine you want to teach someone to cook a new dish. The traditional way: you stand behind them, hand-over-hand, for every single repetition. That's teleoperation in robotics — a human puppeteers the robot through each demonstration, and every new task starts from zero. PyRUA-DataFarm asks: what if you showed the student one example, then had a stage director rebuild the entire kitchen in miniature, write the choreography, and film thousands of rehearsals that look indistinguishable from the real kitchen? That's the mechanism here — an LLM coding agent watches one calibration episode, reconstructs the task in simulation (scene geometry, expert controller, success judge), then a video model conditioned on real images renders each rollout as photographic multi-view video. The committed claim: policies trained entirely on this synthetic farm data match or beat policies trained on equivalent teleoperated demonstrations on real robots. The headline numbers are striking — 93 vs. 84 successes out of 100 trials across five tasks. Under distribution shift (unseen tablecloth, colored lighting), farm-trained policies hold at 87 successes while teleoperation-trained policies collapse to 46. The system is not just cheaper — it's more robust, because simulation-rendered diversity is structurally harder to get from a fixed physical setup. The architecture is a pipeline, not a single model. The LLM agent (acting as coding teleoperator) writes simulation code: scene layout, a scripted expert controller, and a binary success judge. The simulator produces exact action trajectories. Then a video generation model, conditioned on real reference images of the actual workspace, renders each simulated rollout as synchronized multi-camera photorealistic video. Independent LLM judges verify both the expert controller's competence and the visual fidelity of each rendered episode before it enters the training set. The policy network trained downstream is a standard vision-language-action model (the paper uses π0 and ACT architectures). The cost structure is the real payload. Adapting a new task costs $21 in API calls (one-time) plus $5 for a rendering contract. Each additional episode runs $0.80 on average for simulation, rendering, and automated review — no robot wear, no operator wages. One hour of three-view training data costs $107 on average, compared to a quoted $117 for teleoperation in China and $290+ in North America (labor alone). The marginal cost curve is what matters: teleoperation scales linearly with human hours, DataFarm scales with API tokens and GPU rendering. The integrity picture is mixed but honest in the right places. The authors compare against teleoperation-trained baselines on real hardware across five tasks — not cherry-picked simulation benchmarks. They report both in-distribution and out-of-distribution results, and the OOD gap (87 vs. 46) is the strongest evidence that farm data carries structural diversity advantages. However, all evaluation is same-team: no independent group has replicated these results, the five tasks are all tabletop manipulation (no locomotion, no deformable objects, no contact-rich assembly), and the success judge itself is an LLM — raising questions about how well the quality gate generalizes to tasks where visual success criteria are ambiguous. The milestone to watch is task complexity. Five tabletop pick-and-place tasks with rigid objects is the proof of concept. The real unlock is 20+ tasks spanning deformable objects, multi-step assembly, and contact-rich manipulation — roughly the complexity of a warehouse packing station. The gap between here and there is primarily in the expert controller's ability to handle contact physics and the video model's ability to render deformation and occlusion consistently. If the pipeline holds at that complexity, robotic data collection becomes a software cost, not a hardware-and-labor cost. The obvious experiment not run: scaling to tasks where the scripted expert controller cannot be trivially written — assembly with tight tolerances, cable routing, cloth folding. The honest read is (a) and (c): the current expert-controller-writing approach likely struggles with high-dimensional contact physics, and extending to those domains is the natural next paper. The authors acknowledge tabletop scope but don't show failure cases where the agent couldn't reconstruct a task, which would be the most informative data point for practitioners.
