VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation
- 类型:arxiv
- 标识:2608.18607
- 链接:https://arxiv.org/abs/2608.18607
- 主分类:multimodal
- 形态:method
- 被引:0
- 被引来源:Semantic Scholar
- S2被引:0
- 影响力被引:0
- TLDR:VA-Judger, a chain-of-thought omni-reward model for joint video-audio generation that first learns from pairs with clear quality gaps to establish structured output and coarse preference discrimination, then distills reliable preference explanations for harder near-quality comparisons via rejection sampling verified against human annotations, and finally performs dimension-wise reinforcement learning that decomposes human feedback into individual quality dimensions for denser reward signals.
- 待LLM分类:否
- 标题中文:VA-Judger:基于人类偏好反馈的联合音视频生成奖励建模
- TLDR中文:VA-Judger:用于联合视频-音频生成的思维链全模态奖励模型。它首先从具有明显质量差距的数据对中学习,以建立结构化输出与粗粒度偏好判别;然后通过对照人工标注进行拒绝采样,蒸馏得到针对更难近质量对比的可靠偏好解释;最终执行按维度分解的强化学习,将人类反馈分解为各个质量维度以获得更密集的奖励信号。
- 来源文件:
- /inbox/tom/_candidates/2026-08-21-agent-rag-longcontext-candidates.json
- [S2 enrich]