
Imagine you hire a caterer for a wedding and pay for prime filet mignon, but suspect they served reheated Costco steaks. You could try to identify the meat by taste (passive attribution), or you could demand the original purchase receipt from the butcher (cryptographic provenance). This paper tests both strategies for AI-generated video — and finds that the taste test falls apart the moment someone microwaves the steak. The committed claim: passive model-attribution for commercial AI video is too fragile for accusatory audit, and only cryptographic metadata (C2PA signatures, China's GB 45438) can support contractual enforcement claims. The authors test six commercial video-generation models across 19 API endpoints, measuring how well fingerprinting probes and zero-shot detectors can identify which model and tier produced a given clip. On raw, untouched files, container-and-bitstream accuracy hits 83.9%. After uniform re-encoding — the kind any intermediary reseller would trivially apply — accuracy craters to 45.3%. That is worse than a coin flip across six models. The architecture is straightforward and deliberately low-tech: no new deep learning model is proposed. Instead, the authors combine passive forensic probes (trained classifiers on codec features, motion patterns, spectral signatures) with metadata surveys of C2PA manifests and GB 45438 compliance across the 19 endpoints. The interesting engineering contribution is the graded audit taxonomy itself — a decision tree that sorts evidence into accusatory (can support contractual claims), review-triggering (warrants further investigation), or insufficient. This is systems thinking applied to a trust problem, not a model-performance paper. One finding is genuinely surprising: subsampling reference videos from 24 fps to 3 fps actually improves zero-shot detection, raising pooled D3 AUROC from 0.845 to 0.988. The intuition is that lower frame rates strip away codec-level noise and expose the generative model's temporal motion priors more cleanly. This is a useful practical insight for anyone building detection pipelines — sometimes less data is more signal. The integrity story is mixed. On the positive side, the authors test across 19 real commercial endpoints and report specific numbers including failure modes. The 187/187 authenticated deliveries from BytePlus Seedance across three tiers and the 100/100 raw tier-swap detection rate are concrete. On the negative side, this is entirely self-validated — no independent group has replicated the audit, no pre-registration exists, and the benchmark endpoints were necessarily chosen by the authors. The honest limitation is that re-encoding and remuxing render even the signed Seedance files unverifiable, meaning the cryptographic chain breaks the moment a middleman touches the file. The bigger field fight here is whether AI-generated media can be reliably attributed at all in adversarial settings, or whether the entire attribution problem must be solved at the issuance layer (signing at generation time) rather than the forensic layer (analyzing after the fact). This paper lands firmly on the issuance side: passive forensics are a losing game against trivial post-processing. The practical implication for anyone buying AI video generation through intermediaries is blunt — if your vendor isn't delivering C2PA-signed files with pinned provenance metadata, you have no enforceable way to verify what model or tier actually produced your content. The gap in the paper is adversarial robustness testing against a motivated attacker who specifically tries to forge or strip C2PA metadata. The authors test re-encoding and remuxing (which breaks provenance), but don't test whether an intermediary could fabricate a valid-looking C2PA manifest pointing to a higher tier. That's the next experiment — and the honest read is they're probably saving it for a follow-up, since it requires a different threat model and potentially cooperation from the API providers to test.
The analogy
You paid for filet mignon but suspect the caterer served reheated Costco steaks. You could try to identify the meat by taste — which works if it's fresh off the grill but fails once it's been microwaved and re-plated. Or you could demand the original butcher's receipt. This paper tests both strategies for AI-generated video and finds the taste test collapses after the simplest reheating.
Butcher receipt
Cryptographic proof-of-purchase that survives reheating: who sold what cut, when, at what grade
C2PA manifest
Cryptographic provenance metadata signed at generation time: which model, which tier, which endpoint
Honest assessment
A well-constructed measurement paper that definitively shows passive video-attribution collapses under trivial post-processing, making the case for cryptographic provenance at generation time. The graded audit taxonomy is genuinely useful for anyone writing contracts with AI video intermediaries. The limitation is that only 1 of 19 endpoints currently supports the framework's strongest evidence tier, and adversarial forgery of provenance metadata is untested. This matters most to procurement teams and platform trust-and-safety engineers today; it matters to everyone if C2PA adoption scales.
What Is CLAIMS?
63
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
3/5
Ladder
3/5
Architecture
3/5
Integrity
3/5
Milestone
4/5
Successor
3/5
What is this paper actually committing to?
Real but narrow: first graded audit combining passive and cryptographic provenance across 19 commercial video-gen APIs. The taxonomy is new; the individual techniques are not.
The field fight
Can AI-generated media be reliably attributed after the fact (forensics), or must trust be established at generation time (cryptographic provenance)?
Side A
Post-hoc forensic detection can keep pace with generative models through better classifiers and feature engineering
Held by: DE-FAKE, DIRE, GenImage detection benchmarks
Side B
Passive forensics are a losing game against trivial post-processing; only signed provenance at issuance solves trust
Held by: C2PA coalition, Adobe CAI, this paper
Milestone tracker
Unlocks: Enforceable supply-chain auditing for AI video intermediaries without requiring passive forensics
Current
1
of 19 endpoints
authenticated tier (BytePlus)
Next
10+
of 19 endpoints
C2PA tier authentication
~2-3 years if C2PA adoption follows current industry trajectory
Verified Facts (6)
Six-model container and bitstream accuracy falls from 83.9% on raw files to 45.3% after uniform re-encoding
Subsampling real references from 24 to 3 fps raises pooled D3 AUROC from 0.845 to 0.988
Only BytePlus authenticates tier claims under our pinned policy, including 187/187 audited deliveries across three Seedance tiers
The audit identifies authenticated contradictions in 100/100 raw 720p signed tier-swap cases, with zero observed false flags on the tested honest pools
19 commercial endpoints surveyed for C2PA and GB 45438 metadata
Tested remuxing and re-encoding leave processed Seedance files unverifiable
Practical Implications (4)
If you procure AI-generated video through intermediaries, demand C2PA-signed deliveries with tier metadata — passive forensic checks will not hold up under scrutiny
Re-encoding destroys model attribution: any pipeline that transcodes video before delivery eliminates your ability to verify the source model
For detection (AI vs real), subsample to 3fps before running zero-shot detectors — counterintuitively, lower frame rates expose generative artifacts more cleanly
The graded audit taxonomy provides a contractual template: specify which evidence tier (accusatory, review, insufficient) is required for different use cases
More latest news
Read all