An LLM That Explains the Rover's Plan Instead of Making It — NASA-Inspired Framework Keeps AI Out of the Decision Loop

LLM-based assistant explains Monte Carlo tree search rover trajectories with 90.9% faithfulness, a 65% jump over zero-shot prompting, by keeping the model in an explanation role rather than a planning role.

Imagine you hire a brilliant translator who speaks both Engineer and Scientist. You don't let them redesign the bridge — you let them explain why the structural engineer chose that beam. That's the core move here: the LLM never touches the planner's decisions. It only explains them after the fact, using domain vocabulary the science team already thinks in. The committed claim is that an LLM-based ReAct agent, paired with curated tool calls and retrieval functions, can faithfully explain uncertainty-aware rover trajectory plans — and that this post-hoc explanation role is where LLMs are most trustworthy in mission-critical settings. The paper draws on a simulator inspired by NASA's VIPER (Volatiles Investigating Polar Exploration Rover) mission, which was targeting lunar south pole ice prospecting before its cancellation. The planning problem itself is multi-objective optimization under probabilistic uncertainty: the rover must balance science objectives, power constraints, terrain hazards, and shifting timelines. The architecture is straightforward: a Monte Carlo tree search (MCTS) planner generates candidate trajectories in simulation, and a ReAct-pattern LLM agent sits downstream, equipped with curated action tools (re-run the planner with modified parameters, query plan databases, retrieve domain definitions). The LLM never modifies the planner's internal decisions. It answers three categories of queries — plan comparisons, feasibility checks, and lookups — by calling tools and composing natural-language answers grounded in planner outputs. The ladder position is interesting but thin. The paper's headline number is 90.9% faithfulness on a query bank, versus roughly 26% for zero-shot prompting of the same LLM without tool access — a ~65 percentage-point improvement. But the baseline here is deliberately weak: zero-shot prompting without domain tools is not a competitive alternative anyone would actually deploy. The paper does not compare against other explainability frameworks (e.g., LIME, SHAP applied to planner features, or structured plan summarization systems). This makes the improvement look dramatic but leaves the real competitive landscape unmapped. Integrity is mixed. The evaluation uses a curated query bank — the authors designed both the queries and the scoring rubric. There is no independent evaluation, no pre-registration, and no mention of released code or data. Faithfulness is scored by the authors against planner outputs, which is the right thing to measure but is self-graded. The VIPER-inspired simulator is custom-built for this work, not a community benchmark. The 90.9% number is on a bank of unspecified size, which limits statistical power assessment. The real contribution is the architectural decision to keep the LLM out of the planning loop entirely. Previous work (cited but not benchmarked against) has embedded LLMs inside planner decision-making, where hallucinations can cascade into bad plans. By restricting the LLM to post-hoc explanation, the failure mode becomes a bad explanation rather than a bad trajectory — a much safer place to be wrong. This is the paper's sharpest insight, and it's more of a design philosophy than a technical breakthrough. The milestone gap is wide. Going from a custom simulator to actual mission-planning integration requires hardened tool APIs, validated faithfulness on real mission data, and trust calibration with actual science teams. The paper is a proof-of-concept, not a deployment-ready system. The obvious next experiment — testing with real VIPER-scale mission data or with actual planetary scientists evaluating explanation quality — was not run, most likely because VIPER was cancelled and access to real mission planning workflows is restricted.