Imagine you're coaching a basketball team, but you can only watch film and shout instructions — you never touch the ball yourself. Some coaches improve their players quickly by reading the game; others give technically correct advice that never translates to the court. This paper asks: which vision-language models are actually good coaches for robot arms, and can we predict coaching quality from their SAT scores? The committed claim: physical Recursive Self-Improvement (RSI) — a robot getting better at manipulation tasks by reflecting on its own failures — follows observable scaling laws that connect a VLM's public benchmark performance to its physical improvement trajectory. The authors introduce PhysRSI-eval, a five-axis scoring system (First-Attempt Performance, Efficiency, Success, Budget, Improvement-from-Failure) tested across 18 manipulation tasks under fixed interaction budgets. The key insight they call the "Physical Barrel Hypothesis": like a barrel that can only hold water to the height of its shortest stave, different capabilities bottleneck different phases of improvement. A model might nail first attempts but fail to learn from errors, or improve efficiently but burn its interaction budget too fast. The architecture story is straightforward: off-the-shelf VLMs (vision-language models from the GPT-4V / Gemini / open-source family) serve as policies that observe workspace images and generate action plans. No fine-tuning on robotics data — the entire question is whether general-purpose multimodal reasoning transfers to physical self-improvement. The feedback loop is the mechanism: the robot attempts a task, the VLM sees what happened, reasons about failure, and adjusts. This is LLM-as-policy with a closed sensorimotor loop, not LLM-as-planner with a human in the loop. The scaling analysis works two directions. First, predicting physical RSI performance from public benchmark scores — asking whether a model's MMLU or vision-QA numbers tell you anything about its ability to coach a robot arm. Second, forecasting late-round improvement from early physical feedback — can you watch a model's first few attempts and predict whether it will eventually succeed? Both directions show legible trends, which is itself a result: physical self-improvement isn't random, it scales. The workspace intervention experiments are where the paper gets genuinely interesting. Removing interaction history degrades late-round success, confirming that memory matters for physical RSI. But frozen workspaces — environments arranged by one task — remain useful for unseen layouts, suggesting transferable spatial reasoning. Three cross-task cases achieve success earlier when leveraging prior task experience. Scene-specific adaptation and reusable experience coexist, which is a more nuanced finding than either "robots generalize" or "robots overfit." Integrity-wise, this is a tech report with a custom benchmark (PhysRSI-eval), not a community standard. The 18 tasks and five-axis metric are self-designed, which means the authors are grading their own homework on what matters. The paper compares multiple VLMs head-to-head, which adds credibility, but the tasks themselves are manipulation-only and the interaction budgets are fixed — real-world deployment would face open-ended budgets and far messier environments. No code release is mentioned, and no independent replication exists. The honest gap: the authors did not run experiments with fine-tuned robotics-specific models (like RT-2 or Octo) as baselines. The entire framing is "general VLMs as zero-shot physical improvers," which sidesteps the question of whether a robotics-trained model with the same parameter count would crush all of them. The likely reason is scope control — comparing against fine-tuned models would change the paper's thesis from "scaling laws for general VLMs" to "general vs. specialist," which is a different (and harder) paper.
