Imagine you're a film editor reviewing dailies. You don't just ask 'does this scene feel right?' — you check each element independently. Does the dog bark when the dog is on screen? Does the thunder crack sync with the lightning flash? Does the background rain sound persist through the right frames? Current automated evaluation of AI-generated audio-video does none of this. It watches the whole clip, computes a single holistic similarity score, and calls it a day. AVC-Reward argues that's like grading an essay by weighing the paper. The core claim: audio-video consistency evaluation needs to happen at the EVENT level, not the clip level. The authors propose a three-tier metric — global narrative harmony, event-level temporal synchronization, and fine-grained attribute alignment — that decomposes a generated clip into discrete audio and visual events, evaluates each independently, then cross-validates across modalities. This is a genuine architectural shift from the 'embed both modalities and compute cosine similarity' paradigm that dominates the field. The framework is instantiated as AVC-Reward, a trainable reward model. To test it, the authors construct AVC-Benchmark, built primarily from positive and negative samples generated by multiple audio-video generation models — not just one architecture's outputs. This is a deliberate choice: the benchmark spans generation paradigms and relation complexities, which matters because a metric trained only on one generator's failure modes will overfit to that generator's artifacts. The ladder position is strong within its niche. AVC-Reward achieves state-of-the-art alignment with human judgment among automatic methods. The paper is explicit that this comparison is against existing automatic metrics — not claiming superhuman evaluation. The key predecessor baselines here are holistic similarity metrics (e.g., AV-Align, ImageBind-based scoring) that treat the entire clip as a unit. AVC-Reward's event-level decomposition is what creates the gap. The most consequential result isn't the benchmark numbers — it's the RL loop. When AVC-Reward is plugged in as an online reinforcement-learning signal for a joint audio-video generation model, the generation quality improves on the consistency dimension. This closes the evaluation-to-training loop: the metric isn't just a report card, it's a gradient signal. That's the difference between a thermometer and a thermostat. Integrity-wise, this is honest but not airtight. The benchmark is author-constructed, not a pre-existing community standard. The human-alignment evaluation is the gold standard here, but the paper doesn't describe pre-registration or blinding protocols for the human study. The project page is public and the approach is well-documented, but code availability at review time is unclear from the abstract alone. The field fight this enters is the growing tension between holistic embedding-similarity metrics and structured, decomposed evaluation for multimodal generation. As joint audio-video models generate increasingly complex scenes — multiple overlapping events, asynchronous cross-modal relationships — holistic metrics hit a ceiling. AVC-Reward bets that event-level decomposition is the path forward. The next milestone isn't a single number but adoption: does the community converge on event-centric evaluation as the standard, or do holistic metrics scale well enough with bigger foundation models?
