论文

本文提出 LLaVA：Large Language and Vision Assistant，一个端到端训练的大型多模态模型，将视觉编码器与 LLM 相结合用于通用视觉和语言理解；并引入 GPT-4 生成的视觉指令微调数据，模型与代码库已开源。This paper presents LLaVA: Large Language and Vision Assistant, an end-to-end trained large multimodal model that connects a vision encoder and LLM for general-purpose visual and language understanding and introduces GPT-4 generated visual instruction tuning data, the model and code base publicly available.

m-RNN 模型直接对给定先前词语和图像条件下生成下一个词的概率分布建模，相较于直接优化排序目标函数进行检索的 SOTA 方法，取得了显著的性能提升。The m-RNN model directly models the probability distribution of generating a word given previous words and an image, and achieves significant performance improvement over the state-of-the-art methods which directly optimize the ranking objective function for retrieval.

分析表明，借助 LLM，美国约 15% 的工作任务可在保持同等质量的前提下显著提速完成，意味着 LLM 驱动的软件将对底层模型经济影响的规模化产生实质性作用。The analysis suggests that, with access to an LLM, about 15% of all worker tasks in the US could be completed significantly faster at the same level of quality, implying that LLM-powered software will have a substantial effect on scaling the economic impacts of the underlying models.

提出极简的 VLP 模型 Vision-and-Language Transformer (ViLT)，其一体化设计将视觉输入处理大幅简化为与文本输入相同的无卷积方式；ViLT 比此前的 VLP 模型快达数十倍，同时下游任务性能具有竞争力甚至更优。A minimal VLP model, Vision-and-Language Transformer (ViLT), monolithic in the sense that the processing of visual inputs is drastically simplified to just the same convolution-free manner that the authors process textual inputs, showing that ViLT is up to tens of times faster than previous VLP models, yet with competitive or better downstream task performance.

Contrastive Captioner (CoCa) 采用极简设计，对图文编码器-解码器基础模型联合使用对比损失与字幕损失进行预训练，从而兼具 CLIP 等对比方法与 SimVLM 等生成方法的能力。Contrastive Captioner (CoCa), a minimalist design to pretrain an image-text encoder-decoder foundation model jointly with contrastive loss and captioning loss, thereby subsuming model capabilities from contrastive approaches like CLIP and generative methods like SimVLM.

本文提出 MiniGPT-4，通过一个投影层将冻结的视觉编码器与冻结的先进 LLM Vicuna 对齐，发现将视觉特征与先进大语言模型恰当对齐可获得类似 GPT-4 所展现的多种先进多模态能力。MiniGPT-4 is presented, which aligns a frozen visual encoder with a frozen advanced LLM, Vicuna, using one projection layer to uncovers that properly aligning the visual features with an advanced large language model can possess numerous advanced multi-modal abilities demonstrated by G PT-4.

本文表明视频掩码自编码器（VideoMAE）是自监督视频预训练（SSVP）的数据高效学习器，并受近期 ImageMAE 启发，提出采用极高掩码比例的定制化视频管状掩码策略。This paper shows that video masked autoencoders (VideoMAE) are data-efficient learners for self-supervised video pre-training (SSVP), and proposes customized video tube masking with an extremely high ratio, inspired by the recent ImageMAE.

本文基于预训练 BLIP-2 模型，对视觉-语言指令微调展开系统全面研究，并提出指令感知的 Query Transformer，用于提取针对给定指令的信息丰富特征。This paper conducts a systematic and comprehensive study on vision-language instruction tuning based on the pretrained BLIP-2 models, and introduces an instruction-aware Query Transformer, which extracts informative features tailored to the given instruction.

本文提出 Chunk Coverage (CC)，一种独立于 oracle 的 RAG 系统检索组件测试充分性准则，结果表明 CC 在无需测试 oracle 的情况下捕获了与有效测试相关的检索多样性。Chunk Coverage (CC), an oracle-independent test adequacy criterion for testing the retrieval component of RAG systems, is introduced and results show that CC captures retrieval diversity relevant to effective testing without requiring test oracles.

研究揭示了 LLM 空间能力中的清晰规律：尽管其仍落后于 SOTA 方法，但具有潜力并能同时处理多种空间约束，从而可扩展到异构场景。A clear pattern is revealed in LLM spatial capabilities: while they still lag behind state-of-the-art approaches, they are promising and can handle multiple spatial constraints simultaneously, enabling scaling to heterogeneous setups.

本文提出 Manager Coercion Benchmark：被测 manager 拥有一个良性任务并有完成动机，但唯一能够礼貌且坚定拒绝执行任务的 agent，正是被测 manager 本身。The Manager Coercion Benchmark is introduced: the manager under test needs a benign task done and has an incentive to deliver, but the only agent that can do it politely and immovably declines, but the only agent that can do it politely and immovably declines is the manager under test.

ReViV 是首个用于整体第一人称 4D 重建的统一框架，能够从单个单目 RGB 视频中同时提取观察者与视角动态，在整体自身体、手部与注视重建以及相机跟踪方面达到 SOTA 精度与效率，同时保持极具竞争力的第一人称深度估计能力。ReViV is the first unified framework for holistic egocentric 4D reconstruction that extracts both viewer and view dynamics from a single monocular RGB video and achieves state-of-the-art accuracy and efficiency across holistic ego-body, hand, and gaze reconstruction, camera tracking, while maintaining highly competitive egocentric depth estimation.

本工作通过 teacher forcing 与 ODE 蒸馏，将一个双向动作条件教师模型逐步蒸馏为因果学生模型，并提出 LongForcing，将学生模型的长时间自展开与扩展时域教师模型对齐，从而缓解累积的分布漂移与自回归漂移。This work progressively distill a bidirectional action-conditioned teacher into a causal student through teacher forcing and ODE distillation, and introduces LongForcing to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift.

本文是面向业务流程中长时间运行、有状态、多步生成式 AI 系统的基于图的工作流路径实践指南，并通过三个可执行示例展示类型化状态、条件路由、确定性工具、重试、中断、检查点与 trace 如何协同工作。This paper is a practitioner guide to graph-based workflow pathways for long-running, stateful, multi-step generative AI systems in business processes and presents three executable recipes to show how typed state, conditional routing, deterministic tools, retries, interrupts, checkpoints, and traces fit together.

在该研究的评估协议下，部分 AI 生成回答获得了高于可用参考答案的评分，尤其当其包含准确且相关的支撑细节时尤为明显。Under the study's evaluation protocol, some AI-generated responses received higher ratings than the available reference answers, particularly when they contained accurate and relevant supporting details, particularly when they contained accurate and relevant supporting details.

本文提出 RF-Agent，通过多 Agent 的 Question-Thinking-Solution-Answer 流水线，基于教材驱动的知识蒸馏来弥补 RF 领域专用推理的空白，为面向 LLM 辅助 RF 电路设计的未来工作提供了可复用的基础。RF-Agent is presented, which addresses the gap in domain-specific RF reasoning through textbook-driven knowledge distillation through a multi-agent Question-Thinking-Solution-Answer pipeline and provides a reusable foundation for future work on LLM-aided RF circuit design.

这些发现表明，即便长上下文评估正从简单检索转向复杂推理，对相关证据的准确 grounding 仍是一项不可或缺且仍有大幅提升空间的能力。These findings suggest that, even as long-context evaluation shifts from simple retrieval toward complex reasoning, accurate grounding in relevant evidence remains an indispensable capability with substantial room for improvement.

本文提出 HACO，一种运行时控制方案，将每次角色请求视为在候选 agent 实例上的可靠性约束选择问题，每个候选实例耦合了角色类型、LLM 与具体执行环境。HACO is proposed, a runtime control scheme that treats each role request as a reliability-constrained selection problem over candidate agent instances, each coupling a role type, an LLM, and a concrete execution environment.

DeepDebug 在两个测试的开源权重 backbone 上均取得了所评估方法中最高的严格归因准确率，在 qwen3.5-9b 上达到 28.8% 的精确 agent 与步骤准确率，而最强的单遍 baseline 为 21.7%。DeepDebug achieves the best strict attribution accuracy among the evaluated methods on both tested open-weight backbones, reaching 28.8 percent exact agent-and-step accuracy on qwen3.5-9b versus 21.7 percent for the strongest single-pass baseline.

EduPanel 是一个基于评分量表、以学习者为条件的 LLM 评判器，通过在多个专用 agent 间分解评估流程，对教学质量的各个方面产出可解释的评估结果，其可靠性与中等水平的人类专家相当。E EduPanel, a rubric-grounded, learner-conditioned LLM judge that decomposes evaluation across specialized agents to produce interpretable assessments for different aspects of teaching quality, achieves reliability comparable to a median human expert.

本文提出 Verbatimize 这一新任务，能够以高质量规范化逐字转录对语音语料库进行可扩展的创建与扩充，并通过有监督的 cross-attention 微调，将不流畅语音上的词级时间戳表现提升至超过强制对齐 baseline。Verbatimize is proposed, a new task enabling scalable creation and enrichment of speech corpora with high-quality canonical verbatim transcriptions and supervised cross-attention fine-tuning that improves word-level timestamps on disfluent speech beyond forced-alignment baselines.

本文研究 SkewAdam——一种基于以下观察构建的优化器：MoE 的三类参数群体在规模与梯度统计上差异足够大，不应共享相同的状态；研究表明优化器状态的存放位置至少与状态容量同等重要。SkewAdam, an optimizer built on the observation that the three parameter populations of an MoE differ enough in size and gradient statistics that they should not receive the same state, is studied, suggesting where optimizer state lives matters at least as much as how much of it there is.

本文描述了 TensorFlow 接口及 Google 构建的该接口实现，已被用于开展研究，并在计算机科学及其他十余个领域中将机器学习系统部署至生产环境。The TensorFlow interface and an implementation of that interface that is built at Google are described, which has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields.

本文推出参数规模从 7B 到 65B 的基础语言模型集合 LLaMA，并证明完全使用公开数据集即可训练出 SOTA 模型，无需依赖专有或不可获取的数据。LLaMA, a collection of foundation language models ranging from 7B to 65B parameters, is introduced and it is shown that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets.

研究发现，在上述多个维度上进行的指令微调可显著提升多种模型类别（PaLM、T5、U-PaLM）、多种提示设定以及多种评测基准（MMLU、BBH、TyDiQA、MGSM、开放式生成）上的表现。It is found that instruction finetuning with the above aspects dramatically improves performance on a variety of model classes (PaLM, T5, U-PaLM), prompting setups, and evaluation benchmarks (MMLU, BBH, TyDiQA, MGSM, open-ended generation).

通过从概率分布的动态 nucleus 中采样文本，可在有效截断不可靠分布尾部的同时保持多样性，使生成文本更接近人类文本质量，在不牺牲流畅性与连贯性的前提下提升多样性。By sampling text from the dynamic nucleus of the probability distribution, which allows for diversity while effectively truncating the less reliable tail of the distribution, the resulting text better demonstrates the quality of human text, yielding enhanced diversity without sacrificing fluency and coherence.

本文指出基于 Transformer 的次二次时间模型的关键缺陷在于无法执行基于内容的推理，并将选择性 SSM 集成到不包含注意力乃至 MLP 块的简化端到端神经网络架构（Mamba）中。This work identifies that a key weakness of subquadratic-time models based on Transformer architecture is their inability to perform content-based reasoning, and integrates selective SSMs into a simplified end-to-end neural network architecture without attention or even MLP blocks (Mamba).

本文为两部分组成的专题论文，介绍物理信息神经网络——一类在训练求解监督学习任务时遵循由一般非线性偏微分方程所描述的物理定律的网络；并展示如何利用这些网络推断偏微分方程的解，以及获得对所有输入坐标和自由参数完全可微的物理信息代理模型。This two part treatise introduces physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations and demonstrates how these networks can be used to infer solutions topartial differential equations, and obtain physics-informed surrogate models that are fully differentiable with respect to all input coordinates and free parameters.

本文认为，可解释 AI 研究总体上有助于推动 AI/ML 在医疗领域的落地，并特别有助于增强透明性与信任。It is argued that research in explainable-AI would generally help to facilitate the implementation of AI/ML in the medical domain, and specifically help to facilitates transparency and trust.

本文从技术演进的角度，对这一快速发展的研究领域进行了广泛综述，跨越超过四分之一世纪的时间跨度（从 1990 年代到 2022 年）。This article extensively reviews this fast-moving research field in the light of technical evolution, spanning over a quarter-century’s time (from the 1990s to 2022).

一个能够将任意自然语言任务轻松映射为人类可读 prompt 形式的系统，并在覆盖多种任务的多任务混合数据上对预训练 encoder-decoder 模型进行微调。A system for easily mapping any natural language tasks into a human-readable prompted form and fine-tune a pretrained encoder-decoder model on this multitask mixture covering a wide variety of tasks.

研究结果表明，文档表示不应被视为检索开始前一次性的固定预处理选择，而应作为一个明确的优化目标。The results suggest that document representation should not be treated as a fixed preprocessing choice made before retrieval begins, but as an explicit optimization target.

本综述聚焦于单图与多格视觉作品中的幽默理解，同时将幽默生成视为新兴的下游前沿方向，并围绕多模态对齐、证据 grounded 推理与可控生成，对基准设计、评估协议与建模范式进行系统综述。This survey focuses on visual humor understanding in single-image and multi-panel artifacts, while treating humor generation as an emerging downstream frontier, and synthesizes benchmark design, evaluation protocols, and modeling paradigms based on multimodal alignment, evidence-grounded reasoning, and controlled generation.

本文提出 IteraSim RAG，一个面向自动化 OpenFOAM 算例生成的 RAG 软件后端，围绕三大局限构建：求解器选择、湍流闭合、边界条件与有限体积默认值。IteraSim RAG is presented, a retrieval-augmented software back-end for automated OpenFOAM case generation built around three limitations: solver selection, turbulence closures, boundary conditions and finite-volume defaults.