Imagine you're judging a cooking competition, but every contestant brought their own oven, their own timer, and their own definition of 'medium rare.' You can't actually compare the dishes — you're comparing kitchens. That's the state of multi-task reinforcement learning with linear temporal logic (LTL) specifications. Jaxolotl standardizes the kitchen. The paper's committed claim: by reimplementing six representative LTL-RL algorithms in a single end-to-end JAX framework with JIT compilation and precompiled symbolic task representations, you can run controlled comparisons up to 220× faster than existing codebases. This isn't a new algorithm — it's the infrastructure that makes honest algorithm comparison possible. The key technical trick is converting LTL formulas into static array representations at compile time, eliminating the Python-level symbolic manipulation that was bottlenecking prior implementations. The six algorithms span the current landscape: LPOPL, LERG, DiRL, DIRL-C, SPECTRL, and a GNN-based approach. Four gridworld-style environments serve as testbeds, with newly curated task suites designed to stress-test different failure modes. The evaluation protocol enforces statistical rigor — multiple seeds, confidence intervals, standardized metrics — which is exactly what the field lacked. The most important finding is diagnostic, not competitive. General methods capable of non-myopic reasoning (planning over multi-step temporal goals) degrade as the number of atomic propositions grows. Meanwhile, methods with stronger scaling properties rely on environment-specific assumptions — effectively hard-coding structure the agent should be learning — and exhibit myopia, failing on tasks requiring long-horizon reasoning. No method dominates. This is a genuine contribution: the field was comparing apples to oranges and didn't know it. The 220× speedup number deserves scrutiny. It's an end-to-end wall-clock comparison against existing Python/PyTorch implementations, which means it includes both algorithmic efficiency gains and the JAX JIT compilation advantage. The speedup is real for practitioners — experiments that took days now take minutes — but it doesn't mean the algorithms themselves are 220× better. It means the benchmark infrastructure stopped being the bottleneck. The modular architecture matters for the field's future. Adding a new algorithm means implementing a few JAX-compatible modules, not rebuilding the entire pipeline. Adding a new environment follows the same pattern. This lowers the barrier to honest comparison substantially. The curated task suites — designed to probe specific failure modes like scaling with propositions, temporal depth, and compositional generalization — are arguably more valuable than the speedup. What's missing is any environment with continuous state spaces or visual observations. The four environments are gridworld variants — clean abstractions that isolate the LTL reasoning problem but don't test whether these methods survive contact with pixel-based or continuous-control domains. The authors likely know this is the obvious next step and are either building it or saving it.
