Imagine you're filling in a crossword puzzle, but instead of guessing each square by checking one clue at a time (and constantly erasing and rewriting), you lay down every constraint simultaneously — across clues, across intersections — and let the grid solve itself. That's the core mechanism here: instead of iteratively regressing a value function onto bootstrapped targets (the standard guess-and-correct loop in offline RL), this paper encodes Bellman optimality as a set of inequality constraints that must all hold at once. The grid fills itself; no erasing needed. The committed claim: you can train an offline RL critic without target networks or exponential moving average updates by lifting the classical linear programming (LP) characterization of Bellman optimality into joint (Q, V) space, constraining only on state-action pairs that actually appear in the dataset. The resulting algorithm, ALBUM, uses hinge-loss penalties instead of hard constraints, detaches multi-step rollout targets via stop-gradient, and matches FQL's average performance on OGBench — a demanding goal-conditioned benchmark — while using the fewest parameters and least peak GPU memory among all compared methods. The ladder here is honest but not crushing. ALBUM matches FQL on average across OGBench and is comparable to recent action-chunking methods (HIQL, DHRL). It does not dominate them. The real value proposition is architectural simplicity: a single critic network, a standard Gaussian policy, no target network, no EMA, no off-policy correction for multi-step returns, no action chunking. That's a meaningful reduction in engineering overhead, even if the headline numbers are ties rather than wins. The authors position this as a Pareto improvement on the complexity–performance frontier rather than a new SOTA on raw returns. Architecturally, ALBUM belongs to the LP-based value-function family — descendants of the classical result that the optimal value function solves a linear program over the Bellman equations. The lift into (Q, V) space is the key move: it avoids the need to evaluate actions outside the dataset (the deadly distribution shift problem in offline RL). The K-step trajectory constraints generalize single-step Bellman inequalities without requiring importance sampling or behavior-policy estimation. Under deterministic dynamics, the authors prove the LP minimizer lies between the best dataset return and the true optimal value — a useful sandwich bound. Integrity is mixed. The theoretical results (uniqueness, invariance to rollout policy, sandwich bound, stationary-point guarantee) hold under deterministic dynamics, which is a strong assumption even if OGBench includes deterministic-dynamics environments. The empirical evaluation uses OGBench, a community benchmark with public tasks, which is good practice. But there's no pre-registration, no code release mentioned in the abstract, and no independent replication. The comparison set (FQL, HIQL, DHRL, IQL, TD3+BC, CRL, GCBC) is recent and relevant, though the paper's own framing — matching rather than beating — invites the question of whether environments where ALBUM underperforms were quietly de-emphasized. The milestone question is about scaling: can this LP-based approach handle high-dimensional continuous-control tasks with stochastic dynamics, or does the deterministic-dynamics assumption become load-bearing? The immediate next number to watch is performance on stochastic-dynamics benchmarks (D4RL, ExoRL) with comparable or better results than FQL. The successor experiment the authors did not run — and the honest read is likely (a) compute/scope — is a head-to-head on D4RL's stochastic Mujoco tasks, where off-policy correction actually matters and deterministic-dynamics theory breaks. For practitioners, the takeaway is concrete: if you're building offline RL systems and spending engineering time on target network tuning, EMA schedules, and off-policy correction for multi-step returns, ALBUM offers a structurally simpler alternative that trades those complexities for a hinge-loss penalty coefficient. The memory and parameter savings are real. The question is whether the simplification holds up outside the OGBench regime.
