Imagine you're teaching someone to tie a knot by showing them a video. If they only copy your finger positions, they'll fail — their hands are a different size. But if they understand where the rope touches each finger and how the crossings work, they can reproduce the knot with hands of any proportion. DexOAK applies exactly this insight to robot dexterous manipulation: instead of mapping human joint angles to robot joint angles (which fails because morphologies differ), it maps the geometric relationship between fingers and the object being manipulated. The committed claim: a learning-based kinematic retargeting system that encodes object-relative contact geometry — not just hand pose — produces substantially better robot manipulation references than pose-only retargeting, and does so at inference speed after training. The mechanism is a two-stage pipeline. First, an optimization step minimizes a graph Laplacian objective over a joint hand-object interaction graph, ensuring the robot hand reproduces the demonstrated contact pattern rather than the human hand's shape. These optimized frames become training seeds for a feed-forward neural network conditioned on human keypoints and object point clouds. The network is then fine-tuned with contact, non-penetration, and self-collision losses — the physics-aware refinement that turns plausible-looking hand poses into ones that actually work when you run a physics simulator or real hardware. Once trained, inference is fast: no per-frame optimization needed, and the network generalizes to unseen data. This amortized design is the engineering payoff — you pay the optimization cost once during training, then deploy cheaply. On the OakInk-v2 benchmark using the Inspire hand, task success rises from 39.5% to 48.4% — a 22.5% relative improvement over the previous state-of-the-art. On ARCTIC (bimanual articulated objects), ADD-AUC jumps from 62.7% to 77.9%, a 24.2% relative gain. These are meaningful numbers in a domain where 40% success rates are considered competitive. The ablation tables trace gains specifically to the object-aware formulation and the contact-loss fine-tuning, not to architecture size or training tricks. Zero-shot transfer from OakInk-v2 to ARCTIC works, and fine-tuning closes most of the remaining gap to in-domain performance — evidence that the learned retargeting function captures generalizable structure rather than dataset-specific patterns. Hardware validation on a real Inspire hand shows 46 out of 56 open-loop replays succeeding across five tasks, which is respectable for open-loop dexterous manipulation without closed-loop correction. The integrity story is solid but bounded. Evaluation uses two established community benchmarks (OakInk-v2 and ARCTIC), and the paper compares against the current strongest retargeting baseline (DexRetarget) rather than a stale strawman. The hardware experiments add credibility beyond simulation-only validation. However, there's no independent replication, the hardware tasks are limited to five, and the 48.4% success rate — while a clear improvement — means more than half of attempts still fail. The field question DexOAK participates in: should robot manipulation learning focus on imitating human body kinematics, or on reproducing the functional geometry of the manipulation task? DexOAK bets hard on functional geometry, and the numbers support it. The next milestone is pushing success rates above 70% with closed-loop control, which would make human-demonstration-to-robot-execution a practical pipeline rather than a research curiosity.
