
Read the paper
Lazy-MOSAIC: Accelerating Skill-Centric Manipulation Planning with Learned Skill-Effect World Models
on Project Page
You know how Google Maps gives you a driving-time estimate before you commit to a route? It doesn't simulate every traffic light — it uses a cheap model to rank candidate routes, then you only drive (the expensive test) on the one that looks best. Lazy-MOSAIC does the same thing for robot manipulation planning: a lightweight learned model predicts whether a skill will work and what the world looks like afterward, so the planner only fires up the expensive physics simulator for the candidates worth checking. The committed claim: by wrapping MOSAIC's skill-centric search in a lazy evaluation layer — where a learned skill-effect world model replaces most simulator calls with sub-millisecond predictions — you can plan multi-step manipulation sequences substantially faster while matching or exceeding the success rate of full-simulation baselines. This is not a new planner architecture; it is an acceleration strategy for an existing one, and that distinction matters. MOSAIC itself was already a smart search framework — it lets parameterized skills guide exploration toward feasible regions of a vast hybrid space (which skill, with what parameters, in what order). The bottleneck was that every candidate skill evaluation required a full physics simulation. Lazy-MOSAIC's key structural move is to decouple hypothesis generation from validation: a cheap learned model proposes a full plan built from predicted outcomes, and only then does the expensive simulator confirm each step. When a prediction turns out wrong, the system repairs only the broken branch of the search tree rather than restarting from scratch. This lazy-then-validate pattern is borrowed from classical graph search (lazy weighted A*) and adapted for the skill-centric manipulation setting. The evaluation domain is cluttered-shelf retrieval — reaching a target object buried behind obstacles, requiring the robot to chain together grasps, placements, pushes, and other skills in sequence. The authors test on tasks of increasing difficulty (more clutter, deeper target placement) and report that Lazy-MOSAIC needs substantially fewer simulator queries than MOSAIC and other baselines to find valid plans, while maintaining or improving success rate. Physical robot demonstrations are included, though the paper (under review) does not provide granular numbers in the abstract. On the integrity front, this is a same-team simulation plus physical demo setup — no independent replication, no community benchmark for cluttered-shelf manipulation planning, and the specific numeric speedups and success rates are not stated in the available abstract. The baselines are MOSAIC itself and presumably other skill-centric or task-and-motion planning (TAMP) approaches, but the abstract does not name them. The code or project page (skill-mosaic.github.io) is referenced. The architectural lineage is clear: this sits in the task-and-motion planning (TAMP) family, specifically the skill-centric branch that uses parameterized manipulation primitives rather than raw action sequences. The lazy evaluation idea draws directly from lazy search in classical AI planning. The learned skill-effect model is a neural surrogate — a standard pattern in sim-to-real and model-based RL, applied here not for policy learning but for search guidance. The natural successor experiment is scaling to significantly more diverse skill libraries and longer planning horizons — say, kitchen-scale tasks requiring 10+ skills with tool use. The authors likely didn't run this because the learned model's accuracy degrades with distribution shift across more varied skill types, and training data coverage becomes the binding constraint. That is probably the real frontier, not the planning algorithm itself.
The analogy
Like Google Maps estimating drive times before you commit to a route — a cheap model ranks candidate plans, and you only 'drive' (run the expensive simulator) on the promising ones. When the estimate is wrong, you reroute from the bad segment, not from home.
Maps routing
Cheap travel-time estimates rank routes; you only drive the best candidate; reroute from the wrong turn, not from home
Lazy-MOSAIC
Cheap learned model predicts skill outcomes; planner only simulates promising candidates; repairs broken branch, not whole plan
Honest assessment
Lazy-MOSAIC is a well-motivated engineering contribution that applies a classical acceleration pattern (lazy evaluation) to a modern skill-centric planner. It solves a real bottleneck — simulator cost — with a sensible learned surrogate. But the evaluation is narrow (shelf retrieval only), the abstract lacks specific numbers, and no community benchmarks or independent replication exist. This is a solid workshop-to-conference paper for TAMP researchers, not a field-redefining result. Practitioners building manipulation pipelines with skill libraries should watch the project page for code and detailed results.
What Is CLAIMS?
57
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
3/5
Ladder
3/5
Architecture
4/5
Integrity
2/5
Milestone
2/5
Successor
3/5
What is this paper actually committing to?
Useful but incremental. Lazy evaluation wrapping an existing planner is a known acceleration pattern; applying it to skill-centric TAMP with a learned surrogate is a solid engineering contribution, not a paradigm shift.
The field fight
Should long-horizon manipulation be solved by end-to-end learned policies or structured planners with skill libraries?
Side A
End-to-end policies will generalize; structure is a crutch that doesn't scale
Held by: Diffusion Policy, RT-2, foundation model approaches
Side B
Structured TAMP with skill libraries is more reliable and interpretable; learning should accelerate the planner, not replace it
Held by: MOSAIC, PDDLStream, Logic-Geometric Programming, this paper
Milestone tracker
Unlocks: Reliable multi-step manipulation in unstructured home/warehouse environments without manual engineering per task
Current
<10
skill types
shelf retrieval
Next
20+
skill types
kitchen-scale tasks
~2-3 years; depends on surrogate model generalization and training data coverage
Verified Facts (8)
Authors: Itamar Mishani, Mukund Krishnakumar, Oren Salzman, Maxim Likhachev
Learned skill-effect world model predicts feasibility and world state in a fraction of a millisecond
Every skill in a returned plan is validated in simulation
Evaluated on cluttered-shelf retrieval tasks of increasing difficulty
Demonstrated on a physical robot
Plans substantially faster than baselines with fewer simulator queries while matching or exceeding success rate in every setting
Paper is under review
Project page: skill-mosaic.github.io
Practical Implications (3)
Teams using MOSAIC or similar skill-centric planners can bolt on lazy evaluation with a learned surrogate to cut planning time without sacrificing plan validity
The lazy-then-validate pattern is general — applicable to any planner where candidate evaluation is expensive and a cheap proxy exists
Physical robot demonstrations suggest the sim-to-real gap for the validated plans is manageable, though details are sparse
More latest news
Read all