研究库 论文知识库
Papers · organized/paper_cards

论文

1686 张论文卡片 · OA 绿色

开放获取 全部 绿色 · 1686
AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents
AgentDebugX:面向 LLM Agent 失败可观测性、归因与恢复的开源工具包
arXiv:2607.18754 Agent 智能体 方法 OA · 绿色 被引 6 · S2

DeepDebug 在两个测试的开源权重 backbone 上均取得了所评估方法中最高的严格归因准确率,在 qwen3.5-9b 上达到 28.8% 的精确 agent 与步骤准确率,而最强的单遍 baseline 为 21.7%。DeepDebug achieves the best strict attribution accuracy among the evaluated methods on both tested open-weight backbones, reaching 28.8 percent exact agent-and-step accuracy on qwen3.5-9b versus 21.7 percent for the strongest single-pass baseline.

EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibration
EduPanel:面向教学视频的三 Agent LLM 评判框架——可靠性、互补性与人类信任校准
arXiv:2607.18529 Agent 智能体 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

EduPanel 是一个基于评分量表、以学习者为条件的 LLM 评判器,通过在多个专用 agent 间分解评估流程,对教学质量的各个方面产出可解释的评估结果,其可靠性与中等水平的人类专家相当。E EduPanel, a rubric-grounded, learner-conditioned LLM judge that decomposes evaluation across specialized agents to produce interpretable assessments for different aspects of teaching quality, achieves reliability comparable to a median human expert.

Transcription Policy as a Latent Variable: Activating Controllable Verbatim ASR with Word-Level Timing
转写策略即潜变量:通过词级时序激活可控逐字 ASR
arXiv:2607.18934 评测基准 方法 OA · 绿色 被引 3 · S2

本文提出 Verbatimize 这一新任务,能够以高质量规范化逐字转录对语音语料库进行可扩展的创建与扩充,并通过有监督的 cross-attention 微调,将不流畅语音上的词级时间戳表现提升至超过强制对齐 baseline。Verbatimize is proposed, a new task enabling scalable creation and enrichment of speech corpora with high-quality canonical verbatim transcriptions and supervised cross-attention fine-tuning that improves word-level timestamps on disfluent speech beyond forced-alignment baselines.

Where Should Optimizer State Live? Tiered State Allocation for Memory-Efficient Mixture-of-Experts Training
标题中文:优化器状态应放在哪里?面向内存高效混合专家训练的分层状态分配
arXiv:2607.19058 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文研究 SkewAdam——一种基于以下观察构建的优化器:MoE 的三类参数群体在规模与梯度统计上差异足够大,不应共享相同的状态;研究表明优化器状态的存放位置至少与状态容量同等重要。SkewAdam, an optimizer built on the observation that the three parameter populations of an MoE differ enough in size and gradient statistics that they should not receive the same state, is studied, suggesting where optimizer state lives matters at least as much as how much of it there is.

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
TensorFlow:异构分布式系统上的大规模机器学习
arXiv:1603.04467 LLM 基础设施 方法 OA · 绿色 被引 11880 · S2

本文描述了 TensorFlow 接口及 Google 构建的该接口实现,已被用于开展研究,并在计算机科学及其他十余个领域中将机器学习系统部署至生产环境。The TensorFlow interface and an implementation of that interface that is built at Google are described, which has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields.

Generative Adversarial Networks
生成对抗网络
arXiv:1406.2661 多模态 方法 OA · 绿色 被引 7045 · S2
LLaMA: Open and Efficient Foundation Language Models
LLaMA:开放且高效的基础语言模型
arXiv:2302.13971 LLM 基础设施 方法 OA · 绿色 被引 21912 · S2

本文推出参数规模从 7B 到 65B 的基础语言模型集合 LLaMA,并证明完全使用公开数据集即可训练出 SOTA 模型,无需依赖专有或不可获取的数据。LLaMA, a collection of foundation language models ranging from 7B to 65B parameters, is introduced and it is shown that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets.

Scaling Instruction-Finetuned Language Models
指令微调语言模型的规模化
arXiv:2210.11416 工程化 方法 OA · 绿色 被引 4489 · S2

研究发现,在上述多个维度上进行的指令微调可显著提升多种模型类别(PaLM、T5、U-PaLM)、多种提示设定以及多种评测基准(MMLU、BBH、TyDiQA、MGSM、开放式生成)上的表现。It is found that instruction finetuning with the above aspects dramatically improves performance on a variety of model classes (PaLM, T5, U-PaLM), prompting setups, and evaluation benchmarks (MMLU, BBH, TyDiQA, MGSM, open-ended generation).

The Curious Case of Neural Text Degeneration
神经文本退化的奇异案例
arXiv:1904.09751 LLM 基础设施 方法 OA · 绿色 被引 4635 · S2

通过从概率分布的动态 nucleus 中采样文本,可在有效截断不可靠分布尾部的同时保持多样性,使生成文本更接近人类文本质量,在不牺牲流畅性与连贯性的前提下提升多样性。By sampling text from the dynamic nucleus of the probability distribution, which allows for diversity while effectively truncating the less reliable tail of the distribution, the resulting text better demonstrates the quality of human text, yielding enhanced diversity without sacrificing fluency and coherence.

Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Mamba:基于选择性状态空间的线性时间序列建模
arXiv:2312.00752 LLM 基础设施 方法 OA · 绿色 被引 9460 · S2

本文指出基于 Transformer 的次二次时间模型的关键缺陷在于无法执行基于内容的推理,并将选择性 SSM 集成到不包含注意力乃至 MLP 块的简化端到端神经网络架构(Mamba)中。This work identifies that a key weakness of subquadratic-time models based on Transformer architecture is their inability to perform content-based reasoning, and integrates selective SSMs into a simplified end-to-end neural network architecture without attention or even MLP blocks (Mamba).

Momentum Contrast for Unsupervised Visual Representation Learning
无监督视觉表征学习的动量对比
arXiv:1911.05722 多模态 方法 OA · 绿色 被引 15920 · S2
Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
物理信息深度学习(第一部分):非线性偏微分方程的数据驱动求解
arXiv:1711.10561 工程化 应用落地 OA · 绿色 被引 1212 · S2

本文为两部分组成的专题论文,介绍物理信息神经网络——一类在训练求解监督学习任务时遵循由一般非线性偏微分方程所描述的物理定律的网络;并展示如何利用这些网络推断偏微分方程的解,以及获得对所有输入坐标和自由参数完全可微的物理信息代理模型。This two part treatise introduces physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations and demonstrates how these networks can be used to infer solutions topartial differential equations, and obtain physics-informed surrogate models that are fully differentiable with respect to all input coordinates and free parameters.

What do we need to build explainable AI systems for the medical domain?
构建医疗领域可解释 AI 系统,我们需要什么?
arXiv:1712.09923 评测基准 观点 OA · 绿色 被引 982 · S2

本文认为,可解释 AI 研究总体上有助于推动 AI/ML 在医疗领域的落地,并特别有助于增强透明性与信任。It is argued that research in explainable-AI would generally help to facilitate the implementation of AI/ML in the medical domain, and specifically help to facilitates transparency and trust.

Object Detection in 20 Years: A Survey
目标检测二十年:综述
arXiv:1905.05055 多模态 综述 OA · 绿色 被引 3685 · S2

本文从技术演进的角度,对这一快速发展的研究领域进行了广泛综述,跨越超过四分之一世纪的时间跨度(从 1990 年代到 2022 年)。This article extensively reviews this fast-moving research field in the light of technical evolution, spanning over a quarter-century’s time (from the 1990s to 2022).

Multitask Prompted Training Enables Zero-Shot Task Generalization
多任务提示训练实现零样本任务泛化
arXiv:2110.08207 工程化 方法 OA · 绿色 被引 2079 · S2

一个能够将任意自然语言任务轻松映射为人类可读 prompt 形式的系统,并在覆盖多种任务的多任务混合数据上对预训练 encoder-decoder 模型进行微调。A system for easily mapping any natural language tasks into a human-readable prompted form and fine-tune a pretrained encoder-decoder model on this multitask mixture covering a wide variety of tasks.

AutoIndex: Learning Representation Programs for Retrieval
AutoIndex:为检索学习表征程序
arXiv:2607.18603 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

研究结果表明,文档表示不应被视为检索开始前一次性的固定预处理选择,而应作为一个明确的优化目标。The results suggest that document representation should not be treated as a fixed preprocessing choice made before retrieval begins, but as an explicit optimization target.

Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluation, and Challenges
多模态 LLM 的计算幽默:方法、数据集、评估与挑战
arXiv:2607.19011 多模态 综述 OA · 绿色 被引 1 · S2

本综述聚焦于单图与多格视觉作品中的幽默理解,同时将幽默生成视为新兴的下游前沿方向,并围绕多模态对齐、证据 grounded 推理与可控生成,对基准设计、评估协议与建模范式进行系统综述。This survey focuses on visual humor understanding in single-image and multi-panel artifacts, while treating humor generation as an emerging downstream frontier, and synthesizes benchmark design, evaluation protocols, and modeling paradigms based on multimodal alignment, evidence-grounded reasoning, and controlled generation.

IteraSim RAG: A Multi-Stage Retrieval-Augmented Agentic Back-End for OpenFOAM-Based Computational Fluid Dynamics
IteraSim RAG:基于 OpenFOAM 计算流体力学的多阶段检索增强 Agentic 后端
arXiv:2607.20346 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 IteraSim RAG,一个面向自动化 OpenFOAM 算例生成的 RAG 软件后端,围绕三大局限构建:求解器选择、湍流闭合、边界条件与有限体积默认值。IteraSim RAG is presented, a retrieval-augmented software back-end for automated OpenFOAM case generation built around three limitations: solver selection, turbulence closures, boundary conditions and finite-volume defaults.

Overview of FinMMEval 2026 Task 2: Multilingual Financial Short-Answer Question Answering
FinMMEval 2026 任务 2 概述:多语言金融短答问答
arXiv:2607.19867 评测基准 方法 OA · 绿色 被引 4 · S2

FinMMEval 2026 Task 2 围绕多语言证据评估金融领域的短答问答,采用文档 RAG、跨语言证据处理、结构化提示、答案压缩与验证策略。FinMMEval 2026 Task 2 evaluates short-answer financial question answering over multilingual evidence over multilingual evidence using document retrieval-augmented generation, cross-lingual evidence handling, structured prompting, answer compression, and validation strategies.

Self Gradient Forcing: Native Long Video Extrapolation
Self Gradient Forcing:原生长视频外推
arXiv:2607.20368 多模态 方法 OA · 绿色 被引 14 · S2

Self Gradient Forcing(SGF)是一种两阶段训练策略,在原生自回归训练目标内恢复缺失的"记忆写入"监督信号,通过对未来视频 latent 的损失来训练模型将上下文编码为更有效的因果记忆。Self Gradient Forcing (SGF), a two-pass training strategy that restores this missing memory-writing supervision within the native autoregressive training objective, using losses on future video latents to train the model to encode context into more effective causal memory.

Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning
Trace:面向多领域视觉推理的 Taxonomy 引导环境
arXiv:2607.19790 多模态 方法 OA · 绿色 被引 1 · S2

本文提出 Trace,一个面向多领域视觉推理的、由分类体系引导的环境,其将任务构建分解为场景语法与可执行任务程序,将视觉呈现与答案计算解耦,并提供了广泛的程序化训练可迁移到生成任务分布之外的证据。Trace is introduced, a taxonomy-guided environment for multidomain visual reasoning that factorizes task construction into a scene grammar and an executable task program, separating visual realization from answer computation, providing evidence that broad procedural training can transfer beyond the generated task distributions.

Scaling Laws for Hypernetwork-Based Knowledge Injection in Large Language Models
基于超网络知识注入的大语言模型 Scaling Laws
arXiv:2607.19604 LLM 基础设施 方法 OA · 绿色 被引 2 · S2

该设计将 hypernetwork 的注入能力与目标模型的通用能力解耦,首次实现了对 hypernetwork 架构 scaling law 的严格研究,并提供了首个基于实证的 scaling law,用以指导大语言模型中面向事实推理的 hypernetwork 设计。The design decouples the hypernetwork's injection capacity from the target model's general capability, enabling, for the first time, a rigorous study of scaling laws for hypernetwork architectures, and provides the first empirically grounded scaling laws to guide hypernetworks for factual reasoning in large language models.

An Exam for Active Observers
面向主动观察者的评测
arXiv:2607.16165 多模态 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

人类视觉是一个闭环:注视点不断被中间假设而非单一快照持续重定向。数十年的心理物理学与认知科学研究表明,主动观察对多种任务至关重要。当代多模态大语言模型 (MLLM) 是否进行主动观察,是一个现有视觉语言基准无法回答的经验问题。我们提出 ActiveVision,一个使 MLLM 主动观察可度量的基准,包含 3 个类别共 17 个任务,任务设计强制进行重复视觉感知……Human vision is a closed loop: gaze is continuously redirected by intermediate hypotheses rather than a single snapshot. Decades of psychophysics and cognitive science have argued that this active observation is essential for a wide range of tasks. Whether today's multimodal large language models (MLLMs) exercise active observation is an empirical question that current vision-language benchmarks do not answer. We introduce ActiveVision, a benchmark that makes active observation measurable for MLLMs, comprising 17 tasks across 3 categories. Tasks are designed to force repeated visual perception

FVAttn: Adaptive Sparse Attention with Runtime Load Balancing for Video Generation
FVAttn:面向视频生成的自适应稀疏注意力与运行时负载均衡
arXiv:2607.16190 多模态 方法 OA · 绿色 被引 2 · S2

本文提出 \method,一种无需训练的稀疏注意力系统,可在多 GPU 序列并行下提升自适应稀疏注意力的分布式执行效率。This work presents \method, a training-free sparse-attention system that improves the distributed execution efficiency of adaptive sparse attention under multi-GPU sequence parallelism.

Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
通过表征锚定与语言-动作对齐的可泛化 VLA 微调
arXiv:2607.13429 工程化 评测集 OA · 绿色 被引 4 · S2

本文提出 Anchor-Align,通过两个目标增强 BC:Vision-Language Anchoring 从冻结 VLM 副本中蒸馏逐层表示以防止该漂移;Language-Action Alignment 将每个动作目标转换为离散的运动方向标签,并在同一机器人观测上联合训练语言与动作预测。Anchor-Align is proposed, which augments BC with two objectives: Vision-Language Anchoring distills layer-wise representations from a frozen VLM copy to prevent this drift, and Language-Action Alignment converts each action target into a discrete motion-direction label and jointly trains language and action prediction on the same robot observation.

DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations
DocOps:面向复杂文档操作的自主 Agent 可验证基准
arXiv:2607.19865 评测基准 评测集 OA · 绿色 被引 1 · S2

提出 DocOps,一种确定性可验证的评估框架,基于分层分类法,将受真实实践启发的文档操作分解为原子维度与逐级递增的工作流复杂度,从而揭示 Agent 在维护全局文档一致性方面的能力边界。DocOps is introduced, a deterministically verifiable evaluation framework underpinned by a hierarchical taxonomy that deconstructs document operations inspired by real-world practices into atomic dimensions and escalating workflow complexities that exposes the capability boundaries of agents in maintaining global document consistency.

Train the Model, Not the Reader: Decodability Supervision for Verifiable Activation Explanations
训练模型而非读者:用于可验证激活解释的可解码性监督
arXiv:2607.20379 多模态 方法 OA · 绿色 被引 2 · S2

提出两项审计协议——grounding and truth 对比以及 swap to an independent evaluator,以及 RECAP(Readable Encodings via Co-trained Auxiliary Predictors),即与目标模型联合训练的线性头,用于保持指定内容的可解码性。Two audit protocols, the comparison of grounding and truth and the swap to an independent evaluator, and RECAP (Readable Encodings via Co-trained Auxiliary Predictors), linear heads trained alongside the target model to keep designated content decodable are contributed.

Language Models are Few-Shot Learners
Language Models are Few-Shot Learners
arXiv:2005.14165 LLM 基础设施 方法 OA · 绿色 被引 64415 · S2

GPT-3 在多个 NLP 数据集上取得了强劲表现,包括翻译、问答和完形填空任务,以及若干需要即时推理或领域适应的任务,例如乱序词重组、在句子中使用新词、或执行三位数算术运算。GPT-3 achieves strong performance on many NLP datasets, including translation, question-answering, and cloze tasks, as well as several tasks that require on-the-fly reasoning or domain adaptation, such as unscrambling words, using a novel word in a sentence, or performing 3-digit arithmetic.

PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
arXiv:1612.00593 多模态 方法 OA · 绿色 被引 18704 · S2

本文设计了一种直接处理点云的新型神经网络,较好地尊重了输入点的置换不变性,并为从物体分类、部件分割到场景语义解析等应用提供了统一架构。This paper designs a novel type of neural network that directly consumes point clouds, which well respects the permutation invariance of points in the input and provides a unified architecture for applications ranging from object classification, part segmentation, to scene semantic parsing.

Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
arXiv:2307.09288 工程化 方法 OA · 绿色 被引 18503 · S2

本文开发并发布了 Llama 2,这是一系列参数规模从 70 亿到 700 亿不等的预训练与微调大语言模型(LLMs),有望成为闭源模型的合适替代品。This work develops and releases Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters, which may be a suitable substitute for closed-source models.

Deep Learning using Rectified Linear Units (ReLU)
Deep Learning using Rectified Linear Units (ReLU)
arXiv:1803.08375 工程化 方法 OA · 绿色 被引 2488 · OpenAlex

本研究证实了激活函数之间存在统计显著的性能差异,从而再次确认了非饱和函数在深度架构中的必要性,并恢复了对此前文献的恰当历史归属。This study confirms a statistically significant performance variance among activations, thus reaffirming the necessity of non-saturating functions in deep architectures, and restores proper historical attribution to prior literature.

Graph Convolutional Matrix Completion
Graph Convolutional Matrix Completion
arXiv:1706.02263 工程化 方法 OA · 绿色 被引 1413 · S2

一种基于二部交互图上可微分消息传递的图自编码器框架,在标准协同过滤基准上表现出竞争力,并优于近期的 SOTA 方法。A graph auto-encoder framework based on differentiable message passing on the bipartite interaction graph that shows competitive performance on standard collaborative filtering benchmarks and outperforms recent state-of-the-art methods.

MLlib: Machine Learning in Apache Spark
MLlib: Machine Learning in Apache Spark
arXiv:1505.06807 工程化 方法 OA · 绿色 被引 1875 · S2

本文介绍 MLlib,Spark 的开源分布式机器学习库,可为多种学习场景提供高效功能,并包含若干底层的统计、优化和线性代数原语。MLlib is presented, Spark's open-source distributed machine learning library that provides efficient functionality for a wide range of learning settings and includes several underlying statistical, optimization, and linear algebra primitives.

Gemini: A Family of Highly Capable Multimodal Models
Gemini: A Family of Highly Capable Multimodal Models
arXiv:2312.11805 多模态 方法 OA · 绿色 被引 829 · OpenAlex
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
arXiv:1406.2227 多模态 方法 OA · 绿色 被引 1003 · S2

本文提出了一个自然场景文本识别框架,无需任何人工标注数据,并以整体方式对整幅图像进行单词识别,区别于过去基于字符的识别系统。This work presents a framework for the recognition of natural scene text that does not require any human-labelled data, and performs word recognition on the whole image holistically, departing from the character based recognition systems of the past.

Self-Consistency Improves Chain of Thought Reasoning in Language Models
Self-Consistency Improves Chain of Thought Reasoning in Language Models
arXiv:2203.11171 LLM 基础设施 方法 OA · 绿色 被引 7938 · S2

本文提出了一种新的解码策略——self-consistency,用于替代思维链 prompt 中使用的朴素贪心解码:首先采样一组多样化的推理路径,而非仅取贪心路径,然后通过对采样路径进行边缘化来选择最一致的答案。This paper proposes a new decoding strategy, self-consistency, to replace the naive greedy decoding used in chain-of-thought prompting that first samples a diverse set of reasoning paths instead of only taking the greedy one, and then selects the most consistent answer by marginalizing out the sampled reasoning paths.