Imagine a highway interchange where every on-ramp and off-ramp has a toll booth, and each booth serves one lane. If you know which booths are slow, you know which lanes are congested — and from that, you can infer what cargo the other trucks are carrying, even if you never see inside them. That is the core mechanism here: the GPU's load/store unit has internal structures (memory banks and tag-lookup stages) whose contention patterns leak timing information to anyone sharing the hardware. The committed claim: the authors reverse-engineer the full latency model of NVIDIA's load/store unit on recent architectures (Ampere A100, Hopper H100) and show that the resulting attack surface is far broader than any prior GPU side-channel work has demonstrated. They deliver three distinct exploit classes — information leakage, covert communication, and denial-of-service — through channels never previously exploited. This is not one vulnerability; it is a systematic decomposition of a hardware unit that every GPU kernel depends on. The latency model itself is the load-bearing contribution. The authors produce a cycle-accurate formula for a global L1 hit or shared-memory access, parameterized by the addresses touched. The address-dependent terms decompose into two components: bank conflicts (multiple threads hitting the same memory bank) and L1 tag lookups (the cache's internal bookkeeping to find whether data is present). Prior work knew bank conflicts existed; this paper shows that tag lookups are an independent, exploitable contention point. Both can be weaponized separately. The AES-128 key recovery demonstrates the practical ceiling. Using either global bank conflicts or tag lookups alone — channels never exploited before in GPU attacks — they recover a full 128-bit key under the same threat model used in prior GPU AES timing attacks. This matters because defenses designed to block one channel (say, shared-memory bank conflicts) leave the other channel wide open. The attack surface is not a single hole to patch; it is structural. Under NVIDIA's Multi-Process Service (MPS), which is how cloud providers colocate GPU workloads from different tenants, the results get worse. Each contention mechanism (bank access and tag lookup) independently opens a covert channel across processes, and the channel bandwidth increases with each GPU generation — meaning newer, faster GPUs are more vulnerable, not less. The denial-of-service result is striking: a single warp can slow a colocated cuBLAS matrix multiplication by up to 750× on A100 and 563× on H100. That is not a percentage degradation; it is nearly three orders of magnitude. The integrity picture is strong for a hardware-security paper. The results are microbenchmark-driven on real hardware (A100 and H100), not simulation. The latency formula is validated cycle-by-cycle. The AES attack follows an established threat model from prior work, which makes the comparison fair. The main limitation is that the work is necessarily NVIDIA-specific — AMD and Intel GPUs have different LSU designs, and transferability is unknown. The field-level implication is uncomfortable for cloud GPU providers. MPS is the standard mechanism for multi-tenant GPU sharing, and both covert channels and the starvation attack operate under MPS. Hardware-level fixes would require redesigning the LSU pipeline, which touches the most performance-critical path on the chip. Software mitigations (partitioning, scheduling constraints) would sacrifice the utilization gains that MPS exists to provide. There is no cheap fix here.
The analogy
Think of a highway interchange with toll booths on every ramp. If you can measure which booths are backed up, you can infer what cargo the other trucks are carrying — even though you never see inside them. The GPU's load/store unit has internal structures (memory banks and tag-lookup stages) whose congestion patterns leak timing information to any colocated process, exactly the way toll-booth delays reveal traffic composition.
Toll booths
Congestion at specific toll booths reveals which lanes are active and what cargo patterns are flowing through the interchange
LSU contention
Timing variations at memory bank ports and L1 tag-lookup stages reveal which addresses a colocated GPU kernel is accessing
Honest assessment
This is a thorough, hardware-grounded piece of reverse engineering that substantially widens the known GPU attack surface. The cycle-accurate latency model is the real contribution — the attacks are demonstrations of what that model enables. The limitation is NVIDIA-only scope and no independent replication, but for microarchitectural security work this is strong. Cloud GPU providers and anyone colocating sensitive workloads under MPS should pay attention now, not later.
What Is CLAIMS?
80
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
4/5
Architecture
5/5
Integrity
4/5
Milestone
3/5
Successor
4/5
What is this paper actually committing to?
Genuine first: systematic LSU reverse-engineering yielding a cycle-accurate model plus three independent exploit classes through previously unexploited channels. Not one attack — a full surface map.
The field fight
Is GPU multi-tenant isolation under MPS sufficient for security-sensitive cloud workloads?
Side A
MPS isolation plus software scheduling is adequate; hardware side channels are theoretical or narrow
Held by: Cloud providers (AWS, GCP, Azure), NVIDIA MPS design
Side B
MPS provides no meaningful isolation against microarchitectural side channels; colocated tenants can leak, communicate, and DoS each other
Held by: Naghibijouybari et al., Jiang et al., this paper
Milestone tracker
Unlocks: Secure multi-tenant GPU sharing in cloud without sacrificing MPS utilization gains
Current
2
exploit channels
bank conflicts + tag lookups
Next
1
deployed mitigation
MPS isolation that blocks both channels
Unknown — hardware fix is multi-year; software mitigation trades utilization
Verified Facts (7)
Authors reverse-engineer how the LSU serves load instructions on recent NVIDIA GPUs with microbenchmarks
Cycle-accurate latency formula for a global L1 hit or shared memory access from the addresses it touches
Address-dependent terms are bank conflicts and the L1 tag lookup
When the LSU pipeline is full a warp can starve a warp of a later-launched block
Through either global bank conflicts or tag lookups alone, they recover a full AES-128 key under the threat model of prior GPU AES timing attacks
Under MPS, the bank access and the tag lookup each open a covert channel across processes, whose rate rises with each GPU generation
Under MPS, starvation lets one warp slow a colocated cuBLAS matrix multiplication by up to 750x on the A100 and 563x on the H100
Practical Implications (4)
Cloud providers using NVIDIA MPS for multi-tenant GPU sharing have no existing defense against two independent covert channels and a starvation DoS demonstrated on current-gen hardware
Defenses that block shared-memory bank conflicts alone are insufficient — tag-lookup contention is an independent, equally exploitable channel
The 750× slowdown on A100 means a single malicious warp can effectively deny service to colocated cuBLAS workloads, which are foundational to ML inference and training
Security-sensitive GPU workloads (cryptographic operations, proprietary model inference) should not be colocated under MPS without additional isolation mechanisms that do not yet exist
More latest news
Read all