Papers · organized/paper_cards

论文

15 张论文卡片 · 多模态 · OA 绿色

开放获取 全部 绿色 · 724
4. Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented QA
4. 迷失在末尾:多模态检索增强问答中的首因偏差
arXiv:2606.16494 多模态 观点 OA · 绿色 被引 0 · S2 + OpenAlex

研究发现,recall@k 并非已部署 KB-VQA 的正确评价指标,且弥合差距需要 reader 侧介入;本文首次对多模态 KB-VQA 中 reader 侧位置依赖性进行了受控探查,设计了一种 gold-position 协议——在问题提示中仅改变 gold passage 所在的槽位。The findings indicate that recall@k is the wrong metric for deployed KB-VQA and that closing the gap requires reader-side intervention; the first controlled probe of reader-side position dependence in multimodal KB-VQA is designed, a gold-position protocol in which only the gold passage's prompt slot varies within question.

元信息
arXiv:2602.04476 多模态 方法 Open MIND OA · 绿色 被引 8 · S2

本文提出 Vision-aligned Latent Reasoning(VaLR),一种简洁而有效的推理框架,在每个 Chain of Thought 推理步骤之前动态生成视觉对齐的 latent token,引导模型在 latent space 中基于感知线索进行推理。Vision-aligned Latent Reasoning (VaLR) is introduced, a simple, yet effective reasoning framework that dynamically generates vision-aligned latent tokens before each Chain of Thought reasoning step, guiding the model to reason based on perceptual cues in the latent space.

论文信息
arXiv:2606.17053 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 ContextRL,一种上下文感知的强化学习方法,通过间接辅助目标提升长周期推理与多模态性能,并与将相同对比上下文复用作标准 query–context–answer 样本的数据增强基线进行对比。This work proposes ContextRL, a context-aware reinforcement learning (RL) method that improves long-horizon reasoning and multimodal performance through an indirect auxiliary objective, and compares against data-augmentation baselines that repurpose the same contrastive contexts as standard query--context--answer examples.

MMProLong:长上下文视觉语言模型的有效续训练(精读 · flyP)
arXiv:2605.13831 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本研究建立了一套实用的 LongPT 方案,为推进长上下文 vision-language 模型奠定了经验基础,并提出 MMProLong,无需任务专属监督即可泛化至基于网页的多模态 needle 检索、长上下文图文压缩以及长视频理解等任务。This study establishes a practical LongPT recipe and an empirical foundation for advancing long-context vision-language models, and introduces MMProLong, which generalizes to webpage-based multimodal needle retrieval, long-context vision-text compression, and long-video understanding without task-specific supervision.

LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning
LLaDA-V:基于视觉指令微调的大语言扩散模型
arXiv:2505.16933 多模态 方法 OA · 绿色 被引 130 · S2

本文提出 LLaDA-V,一种完全基于扩散范式的多模态大语言模型 (MLLM),将视觉指令微调与 masked diffusion 模型相结合,脱离了当前多模态方法中主流的自回归范式。LLaDA-V is introduced, a purely diffusion-based Multimodal Large Language Model (MLLM) that integrates visual instruction tuning with masked diffusion models, representing a departure from the autoregressive paradigms dominant in current multimodal approaches.

条目S1:To Data & Beyond — Important LLM Papers Week of 12-17 Jan 2026
条目S1:To Data & Beyond — Important LLM Papers Week of 12-17 Jan 2026
arXiv:2601.09668 多模态 方法 OA · 绿色 被引 26 · S2

本文推出 STEP3-VL-10B,一个面向"紧凑效率与前沿级多模态智能"权衡的轻量级开源基础模型,并发布完整模型套件,为社区提供强大、高效且可复现的 baseline。STEP3-VL-10B is presented, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence, and the full model suite is released to provide the community with a powerful, efficient, and reproducible baseline.

条目R1:MAGMaR 2026 Shared Task — 多模态增强生成的ACL 2026 Workshop(arXiv 2606.12295)
arXiv:2606.12295 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文概述了第二届 MAGMaR(Multimodal Retrieval 驱动的多模态增强生成)研讨会共享任务的成果,参赛系统聚焦于视频检索,或在给定检索视频的基础上进行有依据的文章生成。This overview paper presents the results of the shared task for the second workshop on Multimodal Augmented Generation via Multimodal Retrieval (MAGMaR), where participants submitted systems focused on either video retrieval or grounded generation of articles given retrieved videos.

6. LLM Research Papers: The 2026 List (Jan–May) — Sebastian Raschka
LLM 研究论文:2026 年清单(1—5 月)— Sebastian Raschka
arXiv:2602.08071 多模态 方法 Open MIND OA · 绿色 被引 3 · S2

ViT-5 的设计与当代基础模型实践保持一致,可作为对 vanilla ViT 的直接替换升级方案,适用于 2020 年代中期的视觉骨干网络,并为生成建模提供更强大的骨干。With a design aligned with contemporary foundation-model practices, ViT-5 offers a simple drop-in upgrade over vanilla ViT for mid-2020s vision backbones and serves as a stronger backbone for generative modeling.

Multimodal 补充候选
arXiv:2606.13578 多模态 方法 OA · 绿色 被引 1 · S2

构建了 RoboGenesis,一个基于仿真的工作流与数据引擎,可从原子技能组合配置好的实验工作流,对 rollout 进行验证与过滤,并跨支持的机器人配置导出结构化演示数据。RoboGenesis is built, a simulation-based workflow and data engine that composes configured laboratory workflows from atomic skills, validates and filters rollouts, and exports structured demonstrations across supported robot profiles.

Very Deep Convolutional Networks for Large-Scale Image Recognition
Very Deep Convolutional Networks for Large-Scale Image Recognition
arXiv:1409.1556 多模态 方法 OA · 绿色 被引 113645 · S2

本文研究了在采用极小卷积滤波器的架构下,卷积网络深度对大规模图像识别精度的影响,并表明将深度推进至 16-19 个权重层,可在先前 SOTA 配置基础上取得显著提升。This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.

PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
arXiv:1612.00593 多模态 方法 OA · 绿色 被引 18312 · S2

本文设计了一种直接处理点云的新型神经网络,较好地尊重了输入点的置换不变性,并为从物体分类、部件分割到场景语义解析等应用提供了统一架构。This paper designs a novel type of neural network that directly consumes point clouds, which well respects the permutation invariance of points in the input and provides a unified architecture for applications ranging from object classification, part segmentation, to scene semantic parsing.

Gemini: A Family of Highly Capable Multimodal Models
Gemini: A Family of Highly Capable Multimodal Models
arXiv:2312.11805 多模态 方法 OA · 绿色 被引 829 · OpenAlex
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
arXiv:1406.2227 多模态 方法 OA · 绿色 被引 1000 · S2

本文提出了一个自然场景文本识别框架,无需任何人工标注数据,并以整体方式对整幅图像进行单词识别,区别于过去基于字符的识别系统。This work presents a framework for the recognition of natural scene text that does not require any human-labelled data, and performs word recognition on the whole image holistically, departing from the character based recognition systems of the past.

SegFormer: Simple and Efficient Design for Semantic Segmentation with\n Transformers
SegFormer: 基于 Transformers 的简单高效语义分割设计
arXiv:2105.15203 多模态 方法 OA · 绿色 被引 9208 · S2

文章提出了 SegFormer,一个简单高效且强大的语义分割框架,将 Transformers 与轻量级 MLP 解码器统一,并在 Cityscapes-C 上展示了出色的零样本鲁棒性。SegFormer is presented, a simple, efficient yet powerful semantic segmentation framework which unifies Transformers with lightweight multilayer perception (MLP) decoders and shows excellent zero-shot robustness on Cityscapes-C.

Representation Learning with Contrastive Predictive Coding
基于对比预测编码的表征学习
arXiv:1807.03748 多模态 方法 OA · 绿色 被引 14265 · S2

本文提出了一种通用的无监督学习方法——对比预测编码(Contrastive Predictive Coding),用于从高维数据中提取有用的表征,并在语音、图像、文本和 3D 环境中的强化学习四个不同领域取得了出色的性能。This work proposes a universal unsupervised learning approach to extract useful representations from high-dimensional data, which it calls Contrastive Predictive Coding, and demonstrates that the approach is able to learn useful representations achieving strong performance on four distinct domains: speech, images, text and reinforcement learning in 3D environments.