Imagine you're training a new hire by showing them examples of good work, but you keep forgetting to mention the formatting rules because you're focused on the content. A smart new hire doesn't ask you to redo the whole tutorial — they notice what's fuzzy and ask pointed questions: "Should the margins be one inch or 1.5?" That's the core mechanism here. The robot identifies which reward features were poorly covered by the human's demonstrations, then asks targeted preference queries about exactly those features. The committed claim: active preference learning can be made dramatically more efficient by building an informed prior from the robot's own uncertainty about underspecified reward features, combined with natural-language explanations that direct the human's attention. The paper reports a 30.8% improvement over standard active preference learning in low-query regimes — exactly where human effort reduction matters most. The method sits in the reward-learning family, specifically at the intersection of inverse reinforcement learning (IRL) and active preference learning. The robot first learns a reward from demonstrations, identifies features with high posterior uncertainty (the underspecified ones), then constructs preference queries that maximally resolve uncertainty in those specific dimensions. The explanations are the clever twist: they tell the human "pay attention to feature X when comparing these two trajectories," preventing the same attentional bottleneck that caused underspecification in the first place. The baseline is standard active preference learning without the informed prior — a uniform prior over reward parameters. The 30.8% gain is in simulation, specifically in a low-query regime (roughly 5-15 queries). The user study adds ecological validity: both the informed prior and the explanations independently improve reward recovery, and they amplify each other when combined. That multiplicative interaction is the strongest evidence here — it suggests the two mechanisms address different failure modes. Integrity is solid for a CoRL paper. The simulation provides controlled ablation of the informed prior, and the user study tests real human attention and decision-making. The combination of simulation plus user study is the right validation regime for this claim. The limitation is scale: the paper demonstrates on specific task domains, and the question of whether the uncertainty identification transfers to high-dimensional, real-world reward spaces remains open. The milestone to watch is deployment in manipulation or navigation tasks where reward misspecification causes real failures — think a home robot that was taught to clean but not taught to avoid fragile objects. The gap between "we can identify underspecified features" and "we can deploy this in a kitchen" is probably 3-5 years of scaling the feature-identification machinery to richer observation spaces. The obvious experiment not run: scaling to continuous or very high-dimensional feature spaces where the human's attention is split across dozens of task dimensions, not a handful. The honest read is probably (a) — the user study infrastructure and controlled simulation are already substantial work for a conference paper, and the high-dimensional case introduces feature-discovery problems that are a separate research contribution.
