Papers · organized/paper_cards

论文

724 张论文卡片 · OA 绿色

开放获取 全部 绿色 · 724
ChatGPT is not all you need. A State of the Art Review of large Generative AI models
ChatGPT 并非你所需要的一切:大型生成式 AI 模型 SOTA 综述
arXiv:2301.04655 LLM 基础设施 综述 OA · 绿色 被引 358 · S2

本文试图以简洁的方式描述受生成式 AI 影响的主要行业与模型,并给出近期主要生成式模型的分类体系。This work consists on an attempt to describe in a concise way the main models are sectors that are affected by generative AI and to provide a taxonomy of the main generative models published recently.

DeepSeek-V3 Technical Report
DeepSeek-V3 技术报告
arXiv:2412.19437 LLM 基础设施 方法 OA · 绿色 被引 262 · OpenAlex

综合评估表明,DeepSeek-V3 优于其他开源模型,并达到与领先闭源模型相当的性能。Comprehensive evaluations reveal that DeepSeek-V3 outperforms other open-source models and achieves performance comparable to leading closed-source models.

Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
AI 海洋中的海妖之歌:大语言模型幻觉问题综述
arXiv:2309.01219 安全与风险 综述 OA · 绿色 被引 1128 · S2

本文给出了 LLM 幻觉现象与评估基准的分类体系,分析了现有缓解 LLM 幻觉的方法,并讨论了未来研究的潜在方向。This paper presents taxonomies of the LLM hallucination phenomena and evaluation benchmarks, analyzes existing approaches aiming at mitigating LLm hallucination, and discusses potential directions for future research.

Using a Deep Reinforcement Learning Agent for Traffic Signal Control
使用深度强化学习智能体进行交通信号控制
arXiv:1611.01142 Agent 智能体 方法 OA · 绿色 被引 325 · S2

本文在交通微观仿真器 SUMO 中应用现代深度强化学习方法构建一个真正自适应的交通信号控制智能体,并采用一种新的状态空间——离散交通状态编码——其信息密度较高。This work applies modern deep reinforcement learning methods to build a truly adaptive traffic signal control agent in the traffic microsimulator SUMO, using a new state space, the discrete traffic state encoding, which is information dense.

Large Language Models: A Survey
大语言模型综述
arXiv:2402.06196 LLM 基础设施 综述 OA · 绿色 被引 1062 · S2

本文综述了一些最具代表性的 LLM,包括三大主流 LLM 家族(GPT、LLaMA、PaLM),讨论其特性、贡献与局限性,并概述了构建与增强 LLM 的相关技术。This paper reviews some of the most prominent LLMs, including three popular LLM families (GPT, LLaMA, PaLM), and discusses their characteristics, contributions and limitations, and gives an overview of techniques developed to build, and augment LLMs.

A Survey on Evaluation of Large Language Models
大语言模型评估综述
arXiv:2307.03109 评测基准 综述 OA · 绿色 被引 3721 · S2

本文对 LLM 的评估方法进行了全面综述,围绕三个关键维度展开:评估什么、在何处评估、如何评估,并为 LLM 评估领域的研究者提供了宝贵洞见。This paper presents a comprehensive review of these evaluation methods for LLMs, focusing on three key dimensions: what to evaluate, where to evaluate, and how to evaluate, and offers invaluable insights to researchers in the realm of LLMs evaluation.

Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
人工智能中的意识:来自意识科学的洞察
arXiv:2308.08708 安全与风险 观点 OA · 绿色 被引 258 · S2

该报告主张并例证了一种严谨且基于经验的方法来研究 AI 意识:依据获得最佳支持的神经科学意识理论,详细评估现有 AI 系统。This report argues for, and exemplifies, a rigorous and empirically grounded approach to AI consciousness: assessing existing AI systems in detail, in light of best-supported neuroscientific theories of consciousness.

DINOv2: Learning Robust Visual Features without Supervision
DINOv2:无监督学习鲁棒的视觉特征
arXiv:2304.07193 多模态 方法 OA · 绿色 被引 9976 · S2

本文回顾现有方法,并融合多种技术从数据与模型规模两方面扩展预训练,提出一条自动化流水线以构建专用、多样且经过筛选的图像数据集,替代自监督文献中常用的未筛选数据。This work revisits existing approaches and combines different techniques to scale the pretraining in terms of data and model size, and proposes an automatic pipeline to build a dedicated, diverse, and curated image dataset instead of uncurated data, as typically done in the self-supervised literature.

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
BLIP-2:基于冻结图像编码器与大语言模型的 Bootstrap 语言-图像预训练
arXiv:2301.12597 工程化 方法 OA · 绿色 被引 8994 · S2

BLIP-2 在多种视觉-语言任务上取得 SOTA 性能,可训练参数远少于现有方法,并展现出遵循自然语言指令进行零样本图生文的新兴能力。BLIP-2 achieves state-of-the-art performance on various vision-language tasks, despite having significantly fewer trainable parameters than existing methods, and is demonstrated's emerging capabilities of zero-shot image-to-text generation that can follow natural language instructions.

Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Tree of Thoughts:大语言模型的审慎问题求解
arXiv:2305.10601 Agent 智能体 方法 OA · 绿色 被引 4726 · S2

一种面向语言模型推理的新框架 Tree of Thoughts (ToT),推广了流行的 Chain of Thought 提示方法,允许在作为问题求解中间步骤的连贯文本单元(thoughts)上进行探索。A new framework for language model inference, Tree of Thoughts (ToT), which generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving.

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Beyond the Imitation Game:语言模型能力的量化与外推
arXiv:2206.04615 评测基准 评测集 OA · 绿色 被引 2608 · S2

在 BIG-bench 上对 OpenAI 的 GPT 模型、Google 内部稠密 Transformer 架构及 Switch 风格稀疏 Transformer 进行评估,模型规模跨越百万至千亿参数,结果显示性能与校准均随规模提升而改善,但绝对水平仍然欠佳。Evaluation of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters finds that model performance and calibration both improve with scale, but are poor in absolute terms.

ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
ScanNet:富含标注的室内场景三维重建
arXiv:1702.04405 多模态 评测集 OA · 绿色 被引 5793 · S2

本文推出 ScanNet,一个 RGB-D 视频数据集,包含 1513 个场景中的 250 万视角,标注有三维相机位姿、表面重建与语义分割,并表明使用该数据可在多项三维场景理解任务上取得 SOTA 性能。This work introduces ScanNet, an RGB-D video dataset containing 2.5M views in 1513 scenes annotated with 3D camera poses, surface reconstructions, and semantic segmentations, and shows that using this data helps achieve state-of-the-art performance on several 3D scene understanding tasks.

Capabilities of GPT-4 on Medical Challenge Problems
GPT-4 在医学挑战性问题上的能力
arXiv:2303.13375 评测基准 评测集 OA · 绿色 被引 1387 · S2

对 SOTA LLM GPT-4 在医学能力考试与基准数据集上进行全面评估,并通过案例研究定性探索其行为,展示了 GPT-4 解释医学推理、为学生定制个性化讲解以及围绕病例交互式构造新反事实场景的能力。A comprehensive evaluation of GPT-4, a state-of-the-art LLM, on medical competency examinations and benchmark datasets and explores the behavior of the model qualitatively through a case study that shows the ability of G PT-4 to explain medical reasoning, personalize explanations to students, and interactively craft new counterfactual scenarios around a medical case.

Code Llama: Open Foundation Models for Code
Code Llama:面向代码的开源基础模型
arXiv:2308.12950 LLM 基础设施 方法 OA · 绿色 被引 3511 · S2
Toolformer: Language Models Can Teach Themselves to Use Tools
Toolformer:语言模型自学使用工具
arXiv:2302.04761 Agent 智能体 方法 OA · 绿色 被引 5230 · S2

本文提出 Toolformer,训练其决定调用哪些 API、何时调用、传入什么参数,以及如何将结果最佳地融入后续 token 预测,在多种下游任务上显著提升零样本性能。This paper introduces Toolformer, a model trained to decide which APIs to call, when to call them, what arguments to pass, and how to best incorporate the results into future token prediction, which achieves substantially improved zero-shot performance across a variety of downstream tasks.

A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity
ChatGPT 在推理、幻觉与交互性方面的多任务、多语言、多模态评估
arXiv:2302.04023 多模态 评测集 OA · 绿色 被引 1809 · S2

研究发现 ChatGPT 在大多数任务上以零样本学习优于其他 LLM,在部分任务上甚至超过微调模型,并且对非拉丁文字语言的理解能力优于生成能力。It is found that ChatGPT outperforms LLMs with zero-shot learning on most tasks and even outperforms fine-tuned models on some tasks and is better at understanding non-Latin script languages than generating them.

Matterport3D: Learning from RGB-D Data in Indoor Environments
Matterport3D:基于室内 RGB-D 数据的学习
arXiv:1709.06158 多模态 评测集 OA · 绿色 被引 2631 · S2

本文介绍 Matterport3D,一个大规模 RGB-D 数据集,包含来自 90 个建筑物级场景共 194,400 张 RGB-D 图像的 10,800 个全景视图,可支持多种监督与自监督计算机视觉任务,包括关键点匹配、视角重叠预测、由彩色图像预测法线、语义分割和区域分类。Matterport3D is introduced, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400RGB-D images of 90 building-scale scenes that enable a variety of supervised and self-supervised computer vision tasks, including keypoint matching, view overlap prediction, normal prediction from color, semantic segmentation, and region classification.

Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
拥抱不完美数据集:医学图像分割中深度学习解决方案综述
arXiv:1908.10454 多模态 综述 OA · 绿色 被引 1035 · S2

本文对上述解决方案进行了详细综述,总结了其技术创新与实验结果,比较了各方法的优势与适用条件,并给出推荐方案。This article provides a detailed review of the solutions above, summarizing both the technical novelties and empirical results, and compares the benefits and requirements of the surveyed methodologies and provides recommended solutions.

Recent Advances in Convolutional Neural Networks
卷积神经网络近期进展
arXiv:1512.07108 多模态 综述 OA · 绿色 被引 6068 · S2

本文详细介绍了 CNN 在多个方面的改进,包括层设计、激活函数、损失函数、正则化、优化与快速计算,并阐述了卷积神经网络在计算机视觉、语音与自然语言处理中的多种应用。This paper details the improvements of CNN on different aspects, including layer design, activation function, loss function, regularization, optimization and fast computation, and introduces various applications of convolutional neural networks in computer vision, speech and natural language processing.

FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications
FlashRT:引导 Agent 部署实时多模态应用的 Agent Harness
arXiv:2607.18171 Agent 智能体 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 FlashRT,一种 Agent Harness,引导编码 Agent 将开发者编写的简易参考实现提升为优化的多 GPU 部署,并可灵活权衡时延与吞吐量等目标指标,证明在专家优化尚不成熟的平台上,由 Agent 驱动的优化具有更高的可扩展性。FlashRT is presented, an agent harness that guides coding agents to lift simple developer-written reference implementations into optimized multi-GPU deployments that flexibly weigh target metrics like latency and throughput, demonstrating that agent-driven optimization can be more scalable on platforms with less mature expert optimization.

TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs
TimeLens2:基于多模态 LLM 的通用视频时序定位
arXiv:2607.17423 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

在七个基准上,TimeLens2-2B 在所有基准上均优于规模相当的所有基线,4B 和 8B 变体则取得了 SOTA 性能,超越了参数量高达 397B 的开源模型。Across seven benchmarks, TimeLens2-2B outperforms all size-matched baselines on every benchmark, while the 4B and 8B variants achieve state-of-the-art performance, surpassing open-source models with up to 397B parameters.

EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary World
EvolvingWorld:用于交互式文学世界中角色扮演 Agent 与世界模型协同进化的开放模式框架
arXiv:2607.17250 Agent 智能体 评测集 OA · 绿色 被引 1 · S2

实验表明,EvolvingWorld 能够通过有效维持持久且一致的角色与世界发展,提升长程模拟能力。Experiments show that EvolvingWorld can improve long-horizon simulation by effectively maintaining persistent, coherent character and world development.

Distilled Reinforcement Learning for LLM Post-training
LLM 后训练的蒸馏强化学习
arXiv:2607.17247 工程化 方法 OA · 绿色 被引 1 · S2

大量实验表明,Distilled RL 在 pass@1 和 pass@k 上均显著优于标准 RL 和 OPD,并能将教师模型中此前无法获得的知识有效迁移至学生模型。Extensive experiments show that Distilled RL substantially outperforms standard RL and OPD in terms of both pass@1 and pass@k, and can effectively transfer previously unavailable knowledge from a teacher model to a student model.

ReflectWorld-MM: An Entity-Oriented Multimodal Memory System for Open-Ended Video Streams
ReflectWorld-MM:面向开放视频流的实体导向多模态记忆系统
arXiv:2607.09759 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出了ReflectWorld-MM,一个面向开放视频流的以实体为中心的多模态记忆系统,在六个长视频和终身记忆基准测试上均达到最优准确率,超越了强记忆Agent和前沿模型。ReflectWorld-MM is proposed, an entity-oriented multimodal memory system for open-ended video streams that achieves the best accuracy on all six long-video and lifelong-memory benchmarks, outperforming strong memory agents and a frontier model.

Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?
自托管AI Agent的自我状态攻击:操作系统防御能做到什么程度?
arXiv:2607.17986 Agent 智能体 方法 OA · 绿色 被引 0 · S2 + OpenAlex

实证结果表明,分层防御栈对大多数攻击单元有效,但仍存在一小部分残余攻击面在操作系统层面本质上不可区分,这表明针对新出现的自我状态攻击类别,需要重新审视操作系统级防御。The empirical results show that a layered defense stack is effective on most attack cells while a small residual attack surface remains structurally indistinguishable at the OS level, suggesting that against the newly established class of self-state attacks, OS-level defense needs to be reconsidered.

Vector Search As Nearest Neighbor Matching: RAG-based Policy Learning in Causal Inference
向量搜索作为最近邻匹配:基于RAG的因果推断策略学习
arXiv:2607.18225 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

该工作将两步方法的遗憾分解为候选生成遗憾和候选内选择遗憾,并利用最近邻估计器和Transformer的预测误差保证对后者进行了界。This work decomposes the regret of the two-step method into candidate-generation regret and within-candidate choice regret, and bound the latter using prediction-error guarantees for nearest-neighbor estimators and transformers.

ShotPlan: Cinematic Video Generation with Learnable Planning Token
ShotPlan:基于可学习规划token的电影级视频生成
arXiv:2607.17675 多模态 观点 OA · 绿色 被引 0 · S2 + OpenAlex

提出了ShotPlan,一个基于视频扩散基础模型构建的、用于显式多镜头电影级视频生成的框架,显著优于现有的电影级视频生成方法,提供更灵活的镜头管理和更强的跨镜头一致性。ShotPlan is proposed, a framework for explicit multi-shot cinematic video generation built upon a video diffusion foundation model that significantly outperforms existing cinematic video generation methods, offering more flexible shot management and stronger inter-shot consistency.

Can Multimodal Large Language Models Understand OCT?
多模态大语言模型能理解OCT吗?
arXiv:2607.16609 多模态 评测集 OA · 绿色 被引 2 · S2

OCT-Bench能够对MLLM进行全面且细粒度的评估,为识别能力瓶颈和推进临床可信的OCT理解奠定基础。OCT-Bench enables comprehensive and fine-grained evaluation of MLLMs, providing a foundation for identifying capability bottlenecks and advancing clinically grounded OCT understanding.

Diagnosing and Calibrating Tool-Call Boundary Drift in Multi-Teacher On-Policy Distillation
多教师在策略蒸馏中工具调用边界漂移的诊断与校准
arXiv:2607.07050 Agent 智能体 方法 OA · 绿色 被引 0 · S2 + OpenAlex

这些结果识别出关键决策支持的遗漏是 Qwen 主设定中的因果机制,并在多个模型族中得到印证,揭示了支持、损失和解码层面干预之间的克制-能力权衡关系。These results identify decision-critical support omission as a causal mechanism in the primary Qwen setting and support it across model families, tracing a restraint-capability trade-off among support-, loss-, and decoding-level interventions.

GigaChat Audio: Time-aware Large Audio Language Model
GigaChat Audio:时间感知的大音频语言模型
arXiv:2607.10387 多模态 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出一个时间感知的音频 LLM,能够基于大规模合成监督(来自级联 pipeline)在长达 120 分钟的输入上回答带有显式时间戳的问题,并在短时长和长时长 benchmark 上取得强劲的时间定位准确率。This work presents a time-aware audio LLM that answers questions with explicit timestamps over up to 120 minutes of input using large-scale synthetic supervision from a cascaded pipeline and achieves strong temporal-grounding accuracy on short and long benchmarks.

GigaAM Multilingual: Foundation Model for Underrepresented Languages
GigaAM Multilingual:面向代表性不足语言的基础模型
arXiv:2607.10371 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文针对中亚低资源语言构建鲁棒基础模型的挑战,提出 GigaAM Multilingual:一个基于 HuBERT 风格目标在 2M 小时音频上预训练的 Conformer encoder,并在预训练阶段引入 cluster 级的数据均衡策略,在微调阶段引入域感知采样方法,以缓解头部语言主导问题。This work addresses the challenge of building robust foundation models for underrepresented Central Asian languages by presenting GigaAM Multilingual, a Conformer encoder pre-trained on 2M hours of audio using a HuBERT-style objective, and introduces a cluster-level data balancing strategy during pre-training and a domain-aware sampling method during fine-tuning to mitigate head-language dominance.

DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environment
DeepSearch-World:可验证环境中深度搜索Agent的自蒸馏
arXiv:2607.07820 Agent 智能体 方法 OA · 绿色 被引 1 · S2

本文提出 DeepSearch-Evolve,一个面向 web agent 的自蒸馏框架,基于 DeepSearch-World——一个具备可复现搜索与页面读取工具的确定性、可验证环境——从而实现长程 web agent 的可扩展自演化。DeepSearch-Evolve is presented, a self-distillation framework for web agents built on DeepSearch-World, a deterministic and verifiable environment with reproducible search and page-reading tools that enables scalable self-evolution for long-horizon web agents.

Very Deep Convolutional Networks for Large-Scale Image Recognition
Very Deep Convolutional Networks for Large-Scale Image Recognition
arXiv:1409.1556 多模态 方法 OA · 绿色 被引 113645 · S2

本文研究了在采用极小卷积滤波器的架构下,卷积网络深度对大规模图像识别精度的影响,并表明将深度推进至 16-19 个权重层,可在先前 SOTA 配置基础上取得显著提升。This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.

VQA: Visual Question Answering
VQA: Visual Question Answering
arXiv:1505.00468 多模态 评测集 OA · 绿色 被引 6654 · S2
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million\n Narrated Video Clips
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
arXiv:1906.03327 多模态 方法 OA · 绿色 被引 1510 · S2

在 YouCook2、CrossTask 等教学视频数据集上,基于该数据训练的文本-视频 embedding 在文本到视频检索与动作定位任务上达到了 SOTA 结果。It is demonstrated that a text-video embedding trained on this data leads to state-of-the-art results for text-to-video retrieval and action localization on instructional video datasets such as YouCook2 or CrossTask.

Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
arXiv:2107.07651 多模态 方法 OA · 绿色 被引 2913 · S2

提出在通过跨模态注意力融合之前对齐图像与文本表示的对比损失(ALBEF),可实现更扎实的视觉-语言表征学习;并提出动量蒸馏,一种利用动量模型生成伪目标进行自训练的方法。A contrastive loss to ALign the image and text representations BEfore Fusing (ALBEF) them through cross-modal attention, which enables more grounded vision and language representation learning and proposes momentum distillation, a self-training method which learns from pseudo-targets produced by a momentum model.