
Read the paper
ForceHarness: Turning Force into Action and Physics for Frozen Frontier Models
on Project Page
Imagine you're assembling IKEA furniture blindfolded, but you have a friend on a video call describing what they see. They can tell you 'the peg is near the hole,' but the moment you need to feel whether the peg is seating flush or cross-threaded, their eyes are useless. You need a local reflex — your fingers — that closes the loop faster than your friend can talk. ForceHarness is that reflex layer for frozen multimodal models. The committed claim: a frozen, API-only frontier model (GPT-6 Astra) can perform force-dependent manipulation tasks at expert-controller levels without any demonstrations or finetuning, if you wrap it with the right middleware. The middleware has two parts. First, self-terminating force primitives that regulate contact forces autonomously and return control to the model only at discrete contact events — solving the latency mismatch between API round-trips and contact dynamics. Second, a physics translation layer that converts raw force traces into physical quantities with uncertainty bounds, returned as structured tool results the model can actually reason about. The numbers are striking. On a real UR5e arm without a wrist force sensor — using only joint-torque-derived hand force — ForceHarness takes GPT-6 Astra from 3.3% to 90.0% zero-shot success. In simulation on ForceBench (a public benchmark), it adds 17.5 percentage points. On HiddenPhys, their new seven-task MuJoCo benchmark designed around hidden physical variables, it adds 34.3 percentage points, surpassing force-aware policies trained on demonstrations and matching hand-written expert controllers. The ablation finding is quietly important: smaller models benefit disproportionately from receiving physical quantities rather than raw force values, suggesting the translation layer is doing real epistemic work. Architecturally, this sits in the tool-augmented LLM family — the same lineage as code interpreters and retrieval-augmented generation, but applied to continuous physical control. The key structural move is factoring the control problem into two timescales: a slow symbolic loop (the frozen model deciding what to do) and a fast force loop (the primitives handling how to do it). The force primitives use impedance control with event-triggered termination. The physics layer performs Bayesian estimation of contact properties (stiffness, friction, mass) from force traces. The model never sees raw sensor streams — it sees 'estimated stiffness: 450 ± 30 N/m.' This is a deliberate information-bottleneck design. The validation is unusually thorough for a robotics paper. They test on two benchmarks (one public, one new) and real hardware, compare against both trained policies and hand-written expert controllers, and run ablations on the physics translation layer. The real-arm experiment is the crown jewel — no wrist F/T sensor, joint-torque-only calibration, 90% success. The HiddenPhys benchmark is well-motivated: its tasks require inferring physical properties (mass, friction, stiffness) that are invisible to vision. That said, seven tasks is a narrow evaluation surface, and HiddenPhys was designed by the same team, so the benchmark-method circularity risk is nonzero. The milestone this points toward is clear: if force primitives plus physics translation can be generalized across manipulator morphologies and sensor modalities, frozen frontier models become viable zero-shot controllers for the long tail of contact-rich industrial tasks — assembly, insertion, polishing, testing — that currently require per-task programming or learning. The gap is generalization: seven tasks in MuJoCo and a handful of real-arm tasks is a proof of concept, not a deployment story. The next number to watch is task count in the hundreds across diverse manipulators. The obvious experiment not run: scaling to dexterous hands with many contact points and richer force distributions. The paper's force calibration assumes a single end-effector contact. Multi-contact, multi-finger force reasoning would stress every component — the primitives, the physics layer, and the model's ability to reason about multiple simultaneous force channels. My read: this is the next paper, deliberately scoped out to keep the current story clean and publishable. The framework's modular design practically begs for this extension.
The analogy
You're assembling IKEA furniture blindfolded while a friend on video call describes what they see. They're great at 'move left, the peg is near the hole' but useless at 'is it seating flush or cross-threaded.' You need a local finger reflex that works faster than your friend can talk and then reports back 'it's seated, stiffness felt normal.' ForceHarness is that reflex layer — fast local force loops that handle contact and report physics back to the slow visual model in words it understands.
Blindfold assembly
Local finger reflexes close the force loop faster than a remote advisor can speak, then report back in plain language
ForceHarness
Self-terminating force primitives close the contact loop faster than the API model can respond, then return physical quantities as tool results
Honest assessment
ForceHarness is a clean, well-validated proof that frozen frontier models can do force-dependent manipulation if you give them the right middleware. The 3.3% → 90% real-robot number is the headline and it's honestly impressive. The limitation is scope: seven simulation tasks and a handful of real-arm tasks is a proof of concept, not deployment evidence. The self-designed benchmark introduces mild circularity. But the structural idea — factoring control into slow reasoning and fast force reflexes with a physics translation bottleneck — is sound and extensible. If you work in robot manipulation or tool-augmented LLMs, this is worth your afternoon.
What Is CLAIMS?
77
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
4/5
Architecture
4/5
Integrity
3/5
Milestone
4/5
Successor
4/5
What is this paper actually committing to?
Real result, not just a method. 3.3% → 90% on real hardware is a committed claim. The middleware-not-finetuning framing is genuinely novel for force-dependent manipulation with frozen models.
The field fight
Should foundation models be finetuned for embodied control, or augmented with structured middleware?
Side A
Finetune or train end-to-end: the model must internalize physical dynamics to manipulate reliably
Held by: RT-2, Octo, π0, OpenVLA
Side B
Keep the model frozen, wrap it with structured primitives and tool APIs: reasoning generalizes, control is modular
Held by: SayCan, Code-as-Policies, Voxposer, this paper
Milestone tracker
Unlocks: Zero-shot frozen-model control for industrial contact-rich assembly, insertion, testing without per-task programming
Current
7
tasks
HiddenPhys benchmark
Next
100+
tasks
diverse morphologies
~2-3 years if community adopts and extends primitive library
Verified Facts (8)
ForceHarness raises the zero-shot success rate of GPT-6 Astra from 3.3% to 90.0% on a real arm without a wrist force sensor
Adds 17.5 percentage points on the public ForceBench suite
Adds 34.3 percentage points on HiddenPhys
Surpasses force-aware policies trained on demonstrations on both benchmarks
Matches hand-written expert controllers on HiddenPhys
Smaller models make significantly better decisions when given physical quantities rather than raw force values
HiddenPhys is a seven-task MuJoCo benchmark with hidden physical variables
31 pages: 8-page main paper, references, and supplementary material
Practical Implications (4)
Teams deploying frozen multimodal models for manipulation can add force capability without finetuning or demonstration collection — just impedance-controlled primitives and a physics translation wrapper
Joint-torque-only force calibration means you don't need an expensive wrist F/T sensor, lowering hardware cost for force-aware manipulation
The physics translation layer's benefit for smaller models suggests a practical cost optimization: use cheaper models with better middleware rather than scaling model size
HiddenPhys benchmark provides a new evaluation surface for force-dependent manipulation that the community can adopt and extend
More latest news
Read all