Imagine you're learning to cook by watching YouTube videos, but instead of picking tutorials for dishes you actually struggle with, you just watch whatever the algorithm serves. After 50 hours, you're great at scrambled eggs but can't chop an onion. That's the state of most robot imitation learning today — teleoperators collect demonstrations without knowing which demonstrations will actually improve the policy. GUILD closes that loop. The committed claim: guided data collection, where a system actively reasons about which demonstrations to collect next, substantially outperforms passive or human-intuition-driven collection in both sample efficiency and deployment performance. This isn't a new policy architecture or a new training trick — it's a new data collection protocol. The insight is that not all demonstrations are equally useful, and you can estimate which ones will be useful before you collect them. GUILD works in two alternating phases. In the task proposal phase, a vision-language model (VLM) examines the target deployment setting and proposes environment configurations, object placements, and goals that are semantically relevant to the deployment task. This is the cheap, high-coverage step — VLMs are good at generating plausible task variations. But semantic relevance doesn't guarantee policy improvement. A VLM might propose a dozen table configurations, but only three of them expose the policy's actual failure modes. That's where the data evaluation phase comes in. After each round of collection, GUILD uses predictive data attribution — a technique from the influence-function family — to estimate how much each collected trajectory actually moved the needle on a held-out deployment metric. Trajectories that helped get kept and amplified; configurations that produced low-attribution data get deprioritized. This feedback signal is what makes the collection genuinely guided rather than just VLM-prompted. The architecture is a two-loop system: an outer loop iterating between collection rounds and an inner loop training and evaluating the policy. The VLM serves as a semantic prior (think: a knowledgeable but imprecise advisor), while data attribution serves as the empirical corrective (think: the actual exam results). The method is agnostic to the specific policy architecture downstream — it's about what goes into the training set, not how the training set is consumed. Results are shown in both simulation and real robot settings, and the comparison set is reasonable: passive unguided collection, multiple baselines, and experienced human roboticists making their own collection decisions. GUILD beats all of them on sample efficiency, meaning it reaches the same performance with fewer demonstrations. The paper doesn't name a single prior SOTA number to beat — this is more of a paradigm comparison (guided vs. unguided) than a benchmark horse race. That's honest but makes the ladder harder to evaluate. The biggest open question is scaling. Data attribution is computationally expensive — influence functions or their approximations scale poorly with dataset size and model parameter count. Right now this works in a regime where the policy and dataset are small enough for attribution to be tractable. Whether this iterative loop remains practical when the policy is a 1B-parameter vision-language-action model and the dataset is 100K trajectories is the experiment that would make or break the approach for real-world deployment at scale.
