论文

研究发现，recall@k 并非已部署 KB-VQA 的正确评价指标，且弥合差距需要 reader 侧介入；本文首次对多模态 KB-VQA 中 reader 侧位置依赖性进行了受控探查，设计了一种 gold-position 协议——在问题提示中仅改变 gold passage 所在的槽位。The findings indicate that recall@k is the wrong metric for deployed KB-VQA and that closing the gap requires reader-side intervention; the first controlled probe of reader-side position dependence in multimodal KB-VQA is designed, a gold-position protocol in which only the gold passage's prompt slot varies within question.

本文提出 ContextRL，一种上下文感知的强化学习方法，通过间接辅助目标提升长周期推理与多模态性能，并与将相同对比上下文复用作标准 query–context–answer 样本的数据增强基线进行对比。This work proposes ContextRL, a context-aware reinforcement learning (RL) method that improves long-horizon reasoning and multimodal performance through an indirect auxiliary objective, and compares against data-augmentation baselines that repurpose the same contrastive contexts as standard query--context--answer examples.

本文推出 STEP3-VL-10B，一个面向"紧凑效率与前沿级多模态智能"权衡的轻量级开源基础模型，并发布完整模型套件，为社区提供强大、高效且可复现的 baseline。STEP3-VL-10B is presented, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence, and the full model suite is released to provide the community with a powerful, efficient, and reproducible baseline.

本文概述了第二届 MAGMaR（Multimodal Retrieval 驱动的多模态增强生成）研讨会共享任务的成果，参赛系统聚焦于视频检索，或在给定检索视频的基础上进行有依据的文章生成。This overview paper presents the results of the shared task for the second workshop on Multimodal Augmented Generation via Multimodal Retrieval (MAGMaR), where participants submitted systems focused on either video retrieval or grounded generation of articles given retrieved videos.

性能评估显示，新训练的深度 CNN 模型 SentiBank 2.0（即 DeepSentiBank）在标注准确率与检索性能上较此前主要采用二分类 SVM 的版本有显著提升。Performance evaluation shows the newly trained deep CNNs model SentiBank 2.0 (or called DeepSentiBank) is significantly improved in both annotation accuracy and retrieval performance, compared to its predecessors which mainly use binary SVM classification models.

在视觉问答与视觉定位任务上对多模态紧凑双线性池化（MCB）进行了广泛评测，结果一致表明 MCB 优于去掉 MCB 的消融版本This work extensively evaluates Multimodal Compact Bilinear pooling (MCB) on the visual question answering and grounding tasks and consistently shows the benefit of MCB over ablations without MCB.

通过引入扩散卷积运算，本文展示了如何从图结构数据中学习基于扩散的表示，并将其作为节点分类的有效基础。Through the introduction of a diffusion-convolution operation, it is shown how diffusion-based representations can be learned from graph-structured data and used as an effective basis for node classification.

本文提出新的计算机视觉基础模型 Florence，通过融入来自 Web 规模图文数据的通用视觉-语言表示，将表征范围从粗粒度（场景）扩展到细粒度、从静态（图像）扩展到动态（视频）、从 RGB 扩展到多种模态（描述、深度等）。This work introduces a new computer vision foundation model, Florence, to expand the representations from coarse (scene) to fine, from static (images) to dynamic (videos), and from RGB to multiple modalities (caption, depth), by incorporating universal visual-language representations from Web-scale image-text data.

本文在每个时间步以骨骼作为输入，引入一种新的正则化方案来学习骨骼关节的共现特征，并提出一种同时作用于 LSTM 神经元门、单元和输出响应的新型 dropout 算法。This work takes the skeleton as the input at each time slot and introduces a novel regularization scheme to learn the co-occurrence features of skeleton joints, and proposes a new dropout algorithm which simultaneously operates on the gates, cells, and output responses of the LSTM neurons.