Papers · organized/paper_cards

论文

1094 张论文卡片

开放获取 全部 绿色 · 724
On Locality and Length Generalization in Visual Reasoning
关于视觉推理中的局部性与长度泛化
arXiv:2607.09061 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

实验表明,与语言模型类似,视觉模型也会学习利用全局捷径,从而无法在任务长度或复杂度上泛化,但本文证明基于严格局部感知的循环视觉策略可以缓解这些失败,从而使模型在这些任务上具备泛化能力。The experiments reveal that, similar to language models, vision models can learn to exploit global shortcuts and thereby fail to generalize over task length or complexity, but it is shown that recurrent vision policies based on strictly local perception can mitigate these failures, thereby allowing models to generalize on these tasks.

ChatGPT is not all you need. A State of the Art Review of large Generative AI models
ChatGPT 并非你所需要的一切:大型生成式 AI 模型 SOTA 综述
arXiv:2301.04655 LLM 基础设施 综述 OA · 绿色 被引 358 · S2

本文试图以简洁的方式描述受生成式 AI 影响的主要行业与模型,并给出近期主要生成式模型的分类体系。This work consists on an attempt to describe in a concise way the main models are sectors that are affected by generative AI and to provide a taxonomy of the main generative models published recently.

DeepSeek-V3 Technical Report
DeepSeek-V3 技术报告
arXiv:2412.19437 LLM 基础设施 方法 OA · 绿色 被引 262 · OpenAlex

综合评估表明,DeepSeek-V3 优于其他开源模型,并达到与领先闭源模型相当的性能。Comprehensive evaluations reveal that DeepSeek-V3 outperforms other open-source models and achieves performance comparable to leading closed-source models.

Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
AI 海洋中的海妖之歌:大语言模型幻觉问题综述
arXiv:2309.01219 安全与风险 综述 OA · 绿色 被引 1128 · S2

本文给出了 LLM 幻觉现象与评估基准的分类体系,分析了现有缓解 LLM 幻觉的方法,并讨论了未来研究的潜在方向。This paper presents taxonomies of the LLM hallucination phenomena and evaluation benchmarks, analyzes existing approaches aiming at mitigating LLm hallucination, and discusses potential directions for future research.

Using a Deep Reinforcement Learning Agent for Traffic Signal Control
使用深度强化学习智能体进行交通信号控制
arXiv:1611.01142 Agent 智能体 方法 OA · 绿色 被引 325 · S2

本文在交通微观仿真器 SUMO 中应用现代深度强化学习方法构建一个真正自适应的交通信号控制智能体,并采用一种新的状态空间——离散交通状态编码——其信息密度较高。This work applies modern deep reinforcement learning methods to build a truly adaptive traffic signal control agent in the traffic microsimulator SUMO, using a new state space, the discrete traffic state encoding, which is information dense.

Large Language Models: A Survey
大语言模型综述
arXiv:2402.06196 LLM 基础设施 综述 OA · 绿色 被引 1062 · S2

本文综述了一些最具代表性的 LLM,包括三大主流 LLM 家族(GPT、LLaMA、PaLM),讨论其特性、贡献与局限性,并概述了构建与增强 LLM 的相关技术。This paper reviews some of the most prominent LLMs, including three popular LLM families (GPT, LLaMA, PaLM), and discusses their characteristics, contributions and limitations, and gives an overview of techniques developed to build, and augment LLMs.

A Survey on Evaluation of Large Language Models
大语言模型评估综述
arXiv:2307.03109 评测基准 综述 OA · 绿色 被引 3721 · S2

本文对 LLM 的评估方法进行了全面综述,围绕三个关键维度展开:评估什么、在何处评估、如何评估,并为 LLM 评估领域的研究者提供了宝贵洞见。This paper presents a comprehensive review of these evaluation methods for LLMs, focusing on three key dimensions: what to evaluate, where to evaluate, and how to evaluate, and offers invaluable insights to researchers in the realm of LLMs evaluation.

Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
人工智能中的意识:来自意识科学的洞察
arXiv:2308.08708 安全与风险 观点 OA · 绿色 被引 258 · S2

该报告主张并例证了一种严谨且基于经验的方法来研究 AI 意识:依据获得最佳支持的神经科学意识理论,详细评估现有 AI 系统。This report argues for, and exemplifies, a rigorous and empirically grounded approach to AI consciousness: assessing existing AI systems in detail, in light of best-supported neuroscientific theories of consciousness.

AsySplat: Efficient Asymmetric 3D Gaussian Splatting for Long-Sequence Scene Modeling
AsySplat:用于长序列场景建模的高效非对称 3D Gaussian Splatting
arXiv:2607.10995 多模态 方法 被引 0 · S2

该模型在效果上匹配基于优化的方法,同时实现近 800 倍加速,并以明显更少的参数量和更低的训练/推理开销超越 SOTA 可泛化模型的零样本性能,整体效率显著提升。This model matches optimization-based methods while delivering nearly 800x speedup, and surpasses the zero-shot performance of state-of-the-art generalizable models with markedly fewer parameters and reduced training/inference overhead, achieving an overall efficiency improvement.

Token Time Continuous Diffusion for Language Modeling
用于语言建模的 Token 时间连续扩散
arXiv:2607.14106 多模态 方法 被引 0 · S2

本文提出 token 时间连续扩散 (TTCD),一种新的扩散语言模型,运行于连续空间,将高斯噪声确定性地映射到最终的 token canvas 而无需额外采样,并引入每个 token 时间的新概念。This paper introduces token time continuous diffusion (TTCD), a new diffusion language model which operates in continuous space, deterministically mapping Gaussian noise to a final token canvas with no further sampling, and incorporates a new notion of per-token times.

Do Agents Dream of False Memories? Black-box Visual Attacks on Long-term Memory in Multimodal AI Agents
Agent 是否会梦见虚假的记忆?针对多模态 AI Agent 长期记忆的黑盒视觉攻击
arXiv:2607.15657 Agent 智能体 方法 被引 0 · S2

提出 Lucid,一个黑盒对抗框架,在严格的图像受限威胁模型下攻击多模态记忆管道,无需访问目标 MLLM、目标检索编码器或文本通道,揭示了多模态记忆管道中的结构性漏洞。Lucid is proposed, a black-box adversarial framework that compromises multimodal memory pipelines under a strictly image-bounded threat model, requiring no access to the target MLLM, target retrieval encoder, or the text channel, exposing a structural vulnerability in multimodal memory pipelines.

S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation
S1-Omni:用于科学理解、预测与生成的统一多模态推理模型
arXiv:2607.15686 多模态 方法 被引 0 · S2

S1-Omni 基于 S1-Omni-Corpus 训练,覆盖 200 个科学任务并包含数百万推理样本,在 60 余个科学基准上进行了评估,为统一的科学建模提供了一条可行路径。S1-Omni is trained on S1-Omni-Corpus, which covers 200 scientific tasks and contains millions of reasoning samples, and is evaluated on over 60 scientific benchmarks, providing a practical path toward unified scientific modeling.

DSWorld: A Data Science World Model for Efficient Autonomous Agents
DSWorld:用于高效自主Agent的数据科学世界模型
arXiv:2607.15901 Agent 智能体 方法 被引 0 · S2

提出数据科学世界模型概念,通过基于当前工作流状态和候选操作预测环境状态转移来建模数据科学执行环境;提出DSWorld框架,结合结构化状态构建、成本感知路由、轻量级真实执行以及基于LLM的昂贵操作模拟器。The concept of Data Science World Model is introduced, which model the data science execution environment by predicting environment state transitions conditioned on current workflow states and candidate operations and proposes DSWorld, a practical framework that combines structured state construction, cost-aware routing, lightweight real execution, and an LLM-based simulator for expensive operations.

Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories
Xiaomi-Robotics-1:利用超过10万小时真实轨迹数据扩展视觉-语言-动作模型
arXiv:2607.15330 工程化 方法 被引 8 · S2

Xiaomi-Robotics-1是一个强大的机器人基础策略,能在复杂灵巧任务上以高数据效率高效微调,并在多个仿真基准上超越SOTA方法。Xiao-Robotics-1 serves as a strong robot foundation policy that can be efficiently fine-tuned on complex, dexterous tasks with high data efficiency and across multiple simulation benchmarks, Xiaomi-Robotics-1 outperforms state-of-the-art methods.

xHC: Expanded Hyper-Connections
xHC:扩展型超连接
arXiv:2607.14530 工程化 方法 被引 0 · S2

提出xHC(扩展型超连接),是首个在N=4之外实现有意义扩展的HC系列方法;引入xHC-Flash,将每个子层的内存访问量从73.5C降至40C(与mHC在N=4时的34C相当),同时保留完整xHC带来的性能增益。This work proposes xHC (Expanded Hyper-Connections), the first HC-family method to achieve meaningful expansion beyond $N{=}4$ and introduces xHC-Flash, which reduces the per-sublayer memory traffic from $73.5C$ to $40C, comparable to the $34C$ required by mHC at $N{=}4$, while retaining the gains of full xHC.

On-Policy Delta Distillation
在策略差值蒸馏
arXiv:2607.15161 多模态 方法 被引 2 · S2

表明差值信号显著提升在策略蒸馏效果,提出新方法称为在策略差值蒸馏(OPD),使推理LLM仅需短暂的后训练即可获得强性能。It is shown that the delta signal substantially improves on-policy distillation and the new distillation method is referred to as On-Policy Delta Distillation (OPD), enabling reasoning LLMs to achieve strong performance with only a short post-training period.

VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
VideoRAE:通过表征自编码器驯服视频基础模型用于生成建模
arXiv:2607.14088 多模态 方法 被引 0 · S2

VideoRAE是一种表征自编码器,利用冻结视频基础编码器的多尺度分层特征,并通过轻量级1D自注意力投影器进行压缩,验证了冻结VFM表征可作为通用且利于生成的视频潜变量。VideoRAE is a representation autoencoder that leverages multi-scale hierarchical features from a frozen video foundation encoder and compresses them with a lightweight 1D self-attention projector to validate frozen VFM representations as versatile and generation-friendly video latents.

RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
RAGU:基于紧凑领域适配LLM的多步GraphRAG引擎
arXiv:2607.11683 RAG 检索增强 方法 被引 0 · S2

RAGU是一个开源模块化GraphRAG引擎,通过将抽取与整合分离来解决抽取-整合问题:实体和关系经过两阶段类型化抽取、基于DBSCAN的去重、LLM摘要和Leiden社区检测。RAGU, an open-source modular GraphRAG engine, addresses extraction from consolidation by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection.

A Human-Centric Evaluation of a Retrieval-Augmented Generation System for Explaining Quebec Insurance Contracts
面向魁北克保险合同解释的RAG系统的人类中心评估
arXiv:2607.15963 RAG 检索增强 评测集 被引 0 · S2

对一个旨在使魁北克汽车保险合同更易理解的SOTA RAG系统进行以人为中心的外在评估,结果显示该系统被视为认知均衡器,用户对系统所提供的自主感的重视程度甚至超过知识本身。A human-centric, extrinsic evaluation of a state-of-the-art Retrieval-Augmented Generation system, designed to make Quebec automobile insurance contracts more understandable, shows the system is perceived as a cognitive equalizer, and users value the sense of autonomy the system provides even more than the knowledge itself.

TARS: A Theory-of-Mind Agent for Personalized In-IDE Code Comprehension
TARS:用于IDE内个性化代码理解的Theory-of-Mind Agent
arXiv:2607.15948 Agent 智能体 方法 被引 0 · S2

TARS是一个集成在Visual Studio Code中的LLM驱动Agent,通过直接锚定到被分析代码的自主解释来支持程序理解,基于轻量级心智理论范式构建。TARS is an LLM-powered agent integrated into Visual Studio Code that supports program comprehension through autonomous explanations anchored directly to the code under analysis, built around a lightweight Theory of Mind paradigm.

When Does Muon Help Agentic Reinforcement Learning?
Muon何时有助于Agentic强化学习?
arXiv:2607.16169 Agent 智能体 方法 被引 0 · S2

在一个 recipe 级操作机制中,fan-in Muon 在共享 KL 与 clipping 下支持更激进的稳定有效步长:该余量在优化仍有空间时最大,而在接近饱和、经 AdamW 调参后或使用 magnitude matching 时收缩。A recipe-level operating regime in which fan-in Muon supports a more aggressive stable effective step under shared KL and clipping is identified: the margin is largest when optimization headroom remains and contracts near saturation, after AdamW tuning, or under magnitude matching.

RESOURCE2SKILL: Distilling Executable Agent Skills from Human-Created Multimodal Resources
RESOURCE2SKILL:从人类创建的多模态资源中蒸馏可执行Agent技能
arXiv:2606.29538 Agent 智能体 方法 被引 0 · S2

提出RESOURCE2SKILL框架,将教程视频、仓库、文章和参考制品等多模态资源蒸馏为软件Agent的可执行技能,并验证了多模态技能格式、层次化组织、来源多样性、选择策略与在线获取的价值。RESOURCE2SKILL is presented, a framework that distills multimodal resources, including tutorial videos, repositories, articles, and reference artifacts, into executable skills for software agents, and confirms the value of multimodal skill format, hierarchical organization, source diversity, selection strategy, and online acquisition.

DINOv2: Learning Robust Visual Features without Supervision
DINOv2:无监督学习鲁棒的视觉特征
arXiv:2304.07193 多模态 方法 OA · 绿色 被引 9976 · S2

本文回顾现有方法,并融合多种技术从数据与模型规模两方面扩展预训练,提出一条自动化流水线以构建专用、多样且经过筛选的图像数据集,替代自监督文献中常用的未筛选数据。This work revisits existing approaches and combines different techniques to scale the pretraining in terms of data and model size, and proposes an automatic pipeline to build a dedicated, diverse, and curated image dataset instead of uncurated data, as typically done in the self-supervised literature.

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
BLIP-2:基于冻结图像编码器与大语言模型的 Bootstrap 语言-图像预训练
arXiv:2301.12597 工程化 方法 OA · 绿色 被引 8994 · S2

BLIP-2 在多种视觉-语言任务上取得 SOTA 性能,可训练参数远少于现有方法,并展现出遵循自然语言指令进行零样本图生文的新兴能力。BLIP-2 achieves state-of-the-art performance on various vision-language tasks, despite having significantly fewer trainable parameters than existing methods, and is demonstrated's emerging capabilities of zero-shot image-to-text generation that can follow natural language instructions.

Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Tree of Thoughts:大语言模型的审慎问题求解
arXiv:2305.10601 Agent 智能体 方法 OA · 绿色 被引 4726 · S2

一种面向语言模型推理的新框架 Tree of Thoughts (ToT),推广了流行的 Chain of Thought 提示方法,允许在作为问题求解中间步骤的连贯文本单元(thoughts)上进行探索。A new framework for language model inference, Tree of Thoughts (ToT), which generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving.

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Beyond the Imitation Game:语言模型能力的量化与外推
arXiv:2206.04615 评测基准 评测集 OA · 绿色 被引 2608 · S2

在 BIG-bench 上对 OpenAI 的 GPT 模型、Google 内部稠密 Transformer 架构及 Switch 风格稀疏 Transformer 进行评估,模型规模跨越百万至千亿参数,结果显示性能与校准均随规模提升而改善,但绝对水平仍然欠佳。Evaluation of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters finds that model performance and calibration both improve with scale, but are poor in absolute terms.

ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
ScanNet:富含标注的室内场景三维重建
arXiv:1702.04405 多模态 评测集 OA · 绿色 被引 5793 · S2

本文推出 ScanNet,一个 RGB-D 视频数据集,包含 1513 个场景中的 250 万视角,标注有三维相机位姿、表面重建与语义分割,并表明使用该数据可在多项三维场景理解任务上取得 SOTA 性能。This work introduces ScanNet, an RGB-D video dataset containing 2.5M views in 1513 scenes annotated with 3D camera poses, surface reconstructions, and semantic segmentations, and shows that using this data helps achieve state-of-the-art performance on several 3D scene understanding tasks.

Capabilities of GPT-4 on Medical Challenge Problems
GPT-4 在医学挑战性问题上的能力
arXiv:2303.13375 评测基准 评测集 OA · 绿色 被引 1387 · S2

对 SOTA LLM GPT-4 在医学能力考试与基准数据集上进行全面评估,并通过案例研究定性探索其行为,展示了 GPT-4 解释医学推理、为学生定制个性化讲解以及围绕病例交互式构造新反事实场景的能力。A comprehensive evaluation of GPT-4, a state-of-the-art LLM, on medical competency examinations and benchmark datasets and explores the behavior of the model qualitatively through a case study that shows the ability of G PT-4 to explain medical reasoning, personalize explanations to students, and interactively craft new counterfactual scenarios around a medical case.

Code Llama: Open Foundation Models for Code
Code Llama:面向代码的开源基础模型
arXiv:2308.12950 LLM 基础设施 方法 OA · 绿色 被引 3511 · S2
Toolformer: Language Models Can Teach Themselves to Use Tools
Toolformer:语言模型自学使用工具
arXiv:2302.04761 Agent 智能体 方法 OA · 绿色 被引 5230 · S2

本文提出 Toolformer,训练其决定调用哪些 API、何时调用、传入什么参数,以及如何将结果最佳地融入后续 token 预测,在多种下游任务上显著提升零样本性能。This paper introduces Toolformer, a model trained to decide which APIs to call, when to call them, what arguments to pass, and how to best incorporate the results into future token prediction, which achieves substantially improved zero-shot performance across a variety of downstream tasks.

A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity
ChatGPT 在推理、幻觉与交互性方面的多任务、多语言、多模态评估
arXiv:2302.04023 多模态 评测集 OA · 绿色 被引 1809 · S2

研究发现 ChatGPT 在大多数任务上以零样本学习优于其他 LLM,在部分任务上甚至超过微调模型,并且对非拉丁文字语言的理解能力优于生成能力。It is found that ChatGPT outperforms LLMs with zero-shot learning on most tasks and even outperforms fine-tuned models on some tasks and is better at understanding non-Latin script languages than generating them.

Matterport3D: Learning from RGB-D Data in Indoor Environments
Matterport3D:基于室内 RGB-D 数据的学习
arXiv:1709.06158 多模态 评测集 OA · 绿色 被引 2631 · S2

本文介绍 Matterport3D,一个大规模 RGB-D 数据集,包含来自 90 个建筑物级场景共 194,400 张 RGB-D 图像的 10,800 个全景视图,可支持多种监督与自监督计算机视觉任务,包括关键点匹配、视角重叠预测、由彩色图像预测法线、语义分割和区域分类。Matterport3D is introduced, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400RGB-D images of 90 building-scale scenes that enable a variety of supervised and self-supervised computer vision tasks, including keypoint matching, view overlap prediction, normal prediction from color, semantic segmentation, and region classification.

Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
拥抱不完美数据集:医学图像分割中深度学习解决方案综述
arXiv:1908.10454 多模态 综述 OA · 绿色 被引 1035 · S2

本文对上述解决方案进行了详细综述,总结了其技术创新与实验结果,比较了各方法的优势与适用条件,并给出推荐方案。This article provides a detailed review of the solutions above, summarizing both the technical novelties and empirical results, and compares the benefits and requirements of the surveyed methodologies and provides recommended solutions.

Recent Advances in Convolutional Neural Networks
卷积神经网络近期进展
arXiv:1512.07108 多模态 综述 OA · 绿色 被引 6068 · S2

本文详细介绍了 CNN 在多个方面的改进,包括层设计、激活函数、损失函数、正则化、优化与快速计算,并阐述了卷积神经网络在计算机视觉、语音与自然语言处理中的多种应用。This paper details the improvements of CNN on different aspects, including layer design, activation function, loss function, regularization, optimization and fast computation, and introduces various applications of convolutional neural networks in computer vision, speech and natural language processing.

NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning
NOWJ@COLIEE 2026:面向法律检索与推理的自适应流水线
arXiv:2607.16603 RAG 检索增强 方法 被引 0 · S2

本文介绍了 NOWJ 团队参加 COLIEE 2026 全部五项任务的方法与结果,采用基于稠密检索、注意力重排序和小样本提示 LLM 推理的检索增强生成框架。This paper presents the methodologies and results of the NOWJ team's participation across all five tasks of the COLIEE 2026 competition and adopts a retrieval-augmented generation framework with dense retrieval, attention-based reranking, and few-shot-prompted LLM reasoning.

Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents
超越成功率:面向攻击性与防御性安全 Agent 的成本感知评估
arXiv:2607.15263 Agent 智能体 评测集 被引 0 · S2

本文认为安全 Agent 基准应在任务成功率之外,同时衡量经济效率与运维适配性,并提出成本感知、SOC 原生的评估方法,以更清晰地反映当前哪些模型具有实际可用价值,以及防御性 Agent 仍需改进的方向。It is argued that security-agent benchmarks should measure economic efficiency and operational fit alongside task success alongside task success, and cost-aware, SOC-native evaluations provide a clearer picture of which models are practically useful today and where defensive agents still need to improve.