Imagine you're managing a restaurant kitchen. You could hire one brilliant chef who plans the menu, preps the ingredients, and plates every dish. Or you could hire a sous chef who breaks orders into steps and a line cook who executes them — and crucially, let them practice together until their handoffs are seamless. This paper argues the second approach wins for web agents tackling complex, multi-step browser tasks. The committed claim: jointly training a hierarchical decomposer-actor system with reinforcement learning produces better long-horizon web navigation than scaling up a single monolithic agent. JHiMA-WebRL pairs a 7B 'decomposer' that breaks tasks into subtasks with a 7B 'actor' that executes each subtask through GUI interactions. The key novelty isn't hierarchy itself — prior modular systems have used separate planners — but that both modules are updated simultaneously during RL training via an extension of Group Relative Policy Optimization (GRPO) with role-specific advantage functions. The ladder is informative but narrow. On WebArena-Lite-v2, the 14B joint system achieves 37.2% success rate versus 24% for ScaleCUA-32B, a monolithic agent fine-tuned with RL under the same protocol. That's a 55% relative improvement using less than half the parameters. The ablations are the real signal: jointly updating the decomposer during RL beats updating only the actor, which validates the core thesis that co-adaptation matters. However, the benchmark is WebArena-Lite-v2 — a curated subset, not the full WebArena — and 37.2% success rate still means nearly two-thirds of tasks fail. Architecturally, this sits in the hierarchical reinforcement learning family, specifically options-framework-adjacent designs where a high-level policy selects temporally extended actions and a low-level policy executes them. The decomposer is bootstrapped via supervised fine-tuning on structured subtask annotations generated by a strong teacher model from multimodal GUI trajectories — a distillation step. The RL phase uses GRPO with hierarchical rollout grouping, meaning decomposer and actor rollouts are grouped separately for advantage estimation. Both modules appear to be vision-language models (given the multimodal GUI input), running at 7B parameters each. Integrity is mixed. The comparison to ScaleCUA-32B under identical training tasks and evaluation protocol is commendable — same-protocol comparison is rarer than it should be. But the benchmark is a lite variant, the baseline is a single comparison point (not a sweep of SOTA agents), and there's no mention of code release, pre-registration, or independent replication. The teacher-model-generated subtask annotations introduce a potential circularity: if the teacher's decomposition style bakes in biases, the entire hierarchy inherits them. The milestone math is straightforward. At 37.2% success on curated web tasks, reliable autonomous web agents need to push past ~80% on full WebArena to be practically deployable for real workflows. That's roughly a 2× improvement on a harder benchmark. The gap between curated-lite and full-benchmark performance is itself an unknown — and the 37.2% number may not transfer cleanly. The obvious next experiment is running JHiMA-WebRL on the full WebArena benchmark and against a broader set of SOTA baselines (AgentQ, SteP, OpenDevin). The honest read: this is likely (a) compute-constrained — full WebArena evaluation with RL training is expensive — and possibly (c) being saved for a follow-up that scales to larger decomposer/actor pairs or tests generalization across web environments.
