Papers · organized/paper_cards

论文

724 张论文卡片 · OA 绿色

开放获取 全部 绿色 · 724
PaLM 2 Technical Report
PaLM 2 技术报告
arXiv:2305.10403 LLM 基础设施 方法 OA · 绿色 被引 1543 · S2

PaLM 2 是一个新的 SOTA 语言模型,相比其前身 PaLM 具有更强的多语言和推理能力,并具备更高的计算效率,能够在不增加额外开销或影响其他能力的前提下在推理时控制输出毒性。PaLM 2 is a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM and enables inference-time control over toxicity without additional overhead or impact on other capabilities.

Compressing Deep Convolutional Networks using Vector Quantization
使用向量量化压缩深度卷积网络
arXiv:1412.6115 LLM 基础设施 方法 OA · 绿色 被引 1235 · S2

本文在使用 SOTA CNN 的情况下,实现了 16–24 倍的网络压缩,仅带来 1% 的分类准确率损失,并发现针对存储开销最大的全连接层进行压缩时,向量量化方法相比现有矩阵分解方法具有明显优势。This paper is able to achieve 16-24 times compression of the network with only 1% loss of classification accuracy using the state-of-the-art CNN, and finds in terms of compressing the most storage demanding dense connected layers, vector quantization methods have a clear gain over existing matrix factorization methods.

Fast Computation of Wasserstein Barycenters
Wasserstein 重心的快速计算
arXiv:1310.4375 工程化 方法 OA · 绿色 被引 837 · S2

本文提出通过熵正则化对 Wasserstein 距离进行平滑处理,由此得到一个严格凸的目标函数,其梯度可借助矩阵缩放算法以显著更低的计算代价求得。The Wasserstein distance is proposed to be smoothed with an entropic regularizer and recover in doing so a strictly convex objective whose gradients can be computed for a considerably cheaper computational cost using matrix scaling algorithms.

A Comprehensive Survey on Transfer Learning
迁移学习全面综述
arXiv:1911.02685 工程化 综述 OA · 绿色 被引 6058 · S2

本综述尝试连接并系统化现有迁移学习研究,全面总结与阐释迁移学习的机制与策略,帮助读者更好地理解当前研究现状与思路。This survey attempts to connect and systematize the existing transfer learning research studies, as well as to summarize and interpret the mechanisms and the strategies of transfer learning in a comprehensive way, which may help readers have a better understanding of the current research status and ideas.

A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
大语言模型中的幻觉综述:原理、分类、挑战与开放问题
arXiv:2311.05232 安全与风险 综述 OA · 绿色 被引 3594 · S2

全面概述了 LLM 幻觉检测方法与基准,并指出 LLM 幻觉领域有前景的研究方向,包括大视觉-语言模型中的幻觉以及 LLM 幻觉中的知识边界理解。A thorough overview of hallucination detection methods and benchmarks is presented and the promising research directions on LLM hallucinations are highlighted, including hallucination in large vision-language models and understanding of knowledge boundaries in LLM hallucinations.

Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs
使用分层可导航小世界图的高效鲁棒近似最近邻搜索
arXiv:1603.09320 数据与向量库 方法 OA · 绿色 被引 2625 · S2

所提出的通用度量空间搜索索引显著优于此前开源的 SOTA 纯向量方法,且该算法与 skip list 结构的相似性便于直接实现均衡的分布式部署。The proposed general metric space search index is able to strongly outperform previous opensource state-of-the-art vector-only approaches and similarity of the algorithm to the skip list structure allows straightforward balanced distributed implementation.

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
预训练基础模型全面综述:从 BERT 到 ChatGPT 的发展历程
arXiv:2302.09419 工程化 综述 OA · 绿色 被引 750 · S2

本综述旨在阐明 PFMs 在可扩展性、安全性、逻辑推理能力、跨领域学习能力以及面向 AGI 的友好交互能力方面的研究。This survey aims to shed light on the research of the PFMs on scalability, security, logical reasoning ability, cross-domain learning ability, and the user-friendly interactive ability for artificial general intelligence.

A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applications
图嵌入全面综述:问题、技术与应用
arXiv:1709.07604 RAG 检索增强 综述 OA · 绿色 被引 1973 · S2

本综述对图嵌入文献进行全面回顾,并提出两种图嵌入分类法,分别对应不同图嵌入问题设置中的挑战以及现有工作如何在解决方案中应对这些挑战。This survey conducts a comprehensive review of the literature in graph embedding and proposes two taxonomies ofGraph embedding which correspond to what challenges exist in differentgraph embedding problem settings and how the existing work addresses these challenges in their solutions.

A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration Perspective
面向机器学习的数据采集综述:大数据–AI 融合视角
arXiv:1811.03402 工程化 综述 OA · 绿色 被引 825 · S2

本综述从数据管理视角对数据收集进行全面研究,提供了相关操作的研究全景图、何时使用何种技术的指导原则,并识别出值得关注的研究挑战。This survey performs a comprehensive study of data collection from a data management point of view, providing a research landscape of these operations, guidelines on which technique to use when, and identify interesting research challenges.

Deep Visual-Semantic Alignments for Generating Image Descriptions
用于生成图像描述的深度视觉-语义对齐
arXiv:1412.2306 安全与风险 方法 OA · 绿色 被引 6111 · S2

提出一个模型,基于图像区域上的 CNN、句子上的双向 RNN 以及通过多模态嵌入对齐两种模态的结构化目标,生成图像及其区域的自然语言描述。A model that generates natural language descriptions of images and their regions based on a novel combination of Convolutional Neural Networks over image regions, bidirectional Recurrent Neural Networks over sentences, and a structured objective that aligns the two modalities through a multimodal embedding is presented.

Federated Learning in Mobile Edge Networks: A Comprehensive Survey
移动边缘网络中的联邦学习:全面综述
arXiv:1909.11875 工程化 综述 OA · 绿色 被引 2355 · S2

在大规模复杂的移动边缘网络中,涉及具有不同约束的异构设备,这为大规模 FL 实施带来了通信成本、资源分配以及隐私安全方面的挑战。In a large-scale and complex mobile edge network, heterogeneous devices with varying constraints are involved, this raises challenges of communication costs, resource allocation, and privacy and security in the implementation of FL at scale.

Online Learning: A Comprehensive Survey
在线学习全面综述
arXiv:1802.02871 工程化 综述 OA · 绿色 被引 851 · S2

本综述旨在通过对基本思想与关键原则的系统回顾以及对不同算法与技术的合理分类,提供在线机器学习文献的全面综述。This survey aims to provide a comprehensive survey of the online machine learning literatures through a systematic review of basic ideas and key principles and a proper categorization of different algorithms and techniques.

MahNMF: Manhattan Non-negative Matrix Factorization
MahNMF:曼哈顿非负矩阵分解
arXiv:1207.3438 工程化 方法 OA · 绿色 被引 162 · S2

提出 Manhattan NMF(MahNMF),通过最小化 $X$ 与 $W^T H$ 之间的 Manhattan 距离建模重尾 Laplacian 噪声,并以迭代方式提升 MahNMF 及其扩展的近似精度。Manhattan NMF (MahNMF) is presented which minimizes the Manhattan distance between $X and $W^T H$ for modeling the heavy tailed Laplacian noise and improves the approximation accuracy iteratively for both MahNMF and its extensions.

Towards Expert-Level Medical Question Answering with Large Language Models
迈向基于大语言模型的专家级医学问答
arXiv:2305.09617 评测基准 应用落地 OA · 绿色 被引 808 · S2

结果表明,通过结合基础 LLM 改进(PaLM 2)、医学领域微调以及包括新颖集成精化方法在内的提示策略,医学问答正快速接近医生水平的表现。Results highlight rapid progress towards physician-level performance in medical question answering by leveraging a combination of base LLM improvements (PaLM 2), medical domain finetuning, and prompting strategies including a novel ensemble refinement approach.

Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
计算机视觉中的生成对抗网络:综述与分类
arXiv:1906.01529 多模态 综述 OA · 绿色 被引 277 · OpenAlex

深入回顾文献中 GAN 相关研究,并从两个视角阐述针对三大挑战所提出的架构变体与损失变体。An in-depth review of GAN-related research in the literature is provided, and an account of the architecture-variant and loss-variants, which have been proposed to handle these three challenges from two perspectives are provided.

2010.06047
2010.06047
arXiv:2010.06047 工程化 方法 OA · 绿色 被引 257 · OpenAlex

总结了利用人工智能以及语音与语言处理预测阿尔茨海默病相关认知衰退的现有研究发现。The existing findings on the use of artificial intelligence, speech, and language processing to predict cognitive decline in the context of Alzheimer’s disease are summarized.

Gemma: Open Models Based on Gemini Research and Technology
Gemma:基于 Gemini 研究与技术的开放模型
arXiv:2403.08295 LLM 基础设施 方法 OA · 绿色 被引 1204 · S2

本文介绍 Gemma,一族基于 Gemini 模型所使用的研究与技术构建的轻量级 SOTA 开源模型,并全面评估模型的安全性与责任性,同时详细描述模型开发过程。This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models, and presents comprehensive evaluations of safety and responsibility aspects of the models, alongside a detailed description of model development.

DataPrep-Bench: Benchmarking LLMs as Training Data Preparators
DataPrep-Bench: 将 LLM 作为训练数据准备器的基准测试
arXiv:2607.20465 工程化 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

提出 DataPrep-Bench,首个统一基准,在共享的下游任务 grounding 协议下,对 LLM 驱动的数据准备在六个领域、多种 base model 上的两类能力进行联合评估。DataPrep-Bench is introduced, the first unified benchmark that jointly evaluates both capabilities under a shared downstream-grounded protocol over six domains and multiple base models of LLM-driven data preparation.

A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facility
一种用于科学设施的纠错型 Agentic 混合 RAG 及基于运维的评估
arXiv:2607.24663 RAG 检索增强 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

已部署的平台与其面向运维的评估共同构成了一条可信赖、统计上可靠的 AI 辅助工作流,适用于设施运维,并可推广到其他大型科学仪器。Together, the deployed platform and its operations-grounded evaluation present a promising workflow for trustworthy, statistically grounded AI assistance in facility operations, transferable to other large scientific instruments.

DeCoRAG: Cognitive Decoupling and Semantic-Aware Cropping for Complex Document Understanding
DeCoRAG:面向复杂文档理解的认知解耦与语义感知裁剪
arXiv:2607.24554 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

DeCoRAG 是一个多模态 Graph RAG pipeline,将知识处理从耦合的视觉-语义推理转向认知层面的 Decoupling,进而把推理空间从稠密、带噪的背景推向纯净、意图驱动的语义簇。DeCoRAG is a multimodal Graph RAG pipeline that shifts knowledge processing from coupled visual-semantic reasoning to cognitive Decoupling, and subsequently drives the reasoning space from dense, noisy backgrounds to purified, intent-driven semantic clusters.

Retrieval-Augmented Large Language Models as Components of Cognitive Computing architecture for Regulatory Knowledge Management
作为认知计算架构组件用于监管知识管理的检索增强型大语言模型
arXiv:2607.24352 RAG 检索增强 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

结果表明,RAG 增强的 LLM 能显著提升生成文本的事实一致性、领域专属性与规范精度,同时降低产生无支持内容的风险;本地部署的 RAG 增强 LLM 不应仅被视为文本生成工具,而应作为认知计算基础设施中的语义处理模块,在法律和信息高度动态的环境中支撑合规与组织决策。The results demonstrate that augmenting LLMs with RAG significantly improves the factual consistency, domain specificity and normative precision of generated texts while reducing the risk of unsupported content generation and indicate that locally deployed LLMs enhanced with RAG should be regarded not merely as text generation tools but as semantic processing modules within cognitive computing infrastructures supporting regulatory compliance and organizational decision-making in environments characterized by high legal and informational volatility.

Rethinking Classifier-Free Guidance in On-Policy Diffusion Distillation
重新思考 On-Policy 扩散蒸馏中的无分类器引导
arXiv:2607.24731 多模态 观点 OA · 绿色 被引 0 · S2 + OpenAlex

将 Positive--Direction Matching (PDM)——一种分支感知的 OPD 目标,分别约束正预测方向与 CFG 条件方向——引入 dense-to-sparse 视频控制;由于朴素的 guided matching 对推理 guidance 尺度极为敏感,分支感知监督可实现更鲁棒、更有效的知识迁移。Positive--Direction Matching (PDM), a branch-aware OPD objective that separately constrains the positive prediction and the CFG conditional direction, is introduced to dense-to-sparse video control, where naive guided matching is highly sensitive to inference guidance scales, while branch-aware supervision enables more robust and effective knowledge transfer.

The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillation
多轮长时程规划的物理机制:从预训练到后训练的单教师与多教师 On-Policy Agentic 蒸馏
arXiv:2607.24720 工程化 方法 OA · 绿色 被引 2 · S2

提出一个统一且受控的多轮环境,可在三阶段精确控制长程规划;研究表明,多教师 on-policy 蒸馏 (MOPD) 通过收敛到跨环境共享的规划模式来整合多种能力。A unified and controlled multi-turn environment that enables precise control of long-horizon planning across three stages is introduced and it is shown that multi-teacher on-policy distillation (MOPD) integrates capabilities by converging to shared planning-pattern across environments.

Evidence Attribution in Visual Document Understanding without Coordinates or Region Labels
无坐标与区域标签的视觉文档理解中的证据归因
arXiv:2607.24651 多模态 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

本研究考察是否存在一条实用路径,在没有坐标界面、且无需高成本区域级监督的条件下提升归因效果,并指出了这样一条可行路径。A study investigates whether there is a practical path to improve attribution without a coordinate interface and without costly region-level supervision, and indicates a practical path to improve attribution without a coordinate interface and without costly region-level supervision.

Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models
通过检索增强型大语言模型利用外部知识进行历史文档修复
arXiv:2607.21936 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出一种面向历史文档修复的新框架,利用搭载 RAG 的大语言模型,有效缓解了推断上下文相关专有名词的难题。A novel framework for historical document restoration that leverages large language models with retrieval-augmented generation (RAG) and effectively mitigates the challenge of inferring context-dependent proper nouns is introduced.

Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification
Sol-Attn:通过即时注意力稀疏化加速视频生成推理
arXiv:2607.24027 多模态 方法 OA · 绿色 被引 2 · S2

本文提出无需训练的 Sol-Attn(Sparsifying online attention),在单次 online-softmax pass 中统一动态路由、稀疏计算与近似修正,在稀疏注意力中取得更好的精度–效率权衡。This paper introduces training-free Sol-Attn (Sparsifying online attention), which unifies dynamic routing, sparse computation, and approximation correction in a single online-softmax pass, achieving a better accuracy-efficiency trade-off in sparse attention.

Chamaileon: Cross-Context Binder Design with Contextualized Modeling and Mixed Sampling
Chamaileon:基于上下文建模与混合采样的跨上下文结合子设计
arXiv:2607.23518 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 Chamaileon,通过将问题建模为跨上下文结合景观(cross-context binding landscape modeling),统一多目标与多态 binder 设计,有效生成可适配多样构象景观与多目标需求的序列。Chamaileon is introduced, which unifies multi-target and multi-state binder design by formulating the problem as cross-context binding landscape modeling and effectively generates sequences adaptable to diverse conformational landscapes and multi-target requirements.

Characterizing Warp Divergence from Pascal to Blackwell
从 Pascal 到 Blackwell 的 Warp 分歧特性分析
arXiv:2607.23402 评测基准 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

即使 NVIDIA 控制流 ISA 与重汇聚(reconvergence)机制持续演进,Divergence 仍能保持稳定且可预期的性能开销。Divergence retains a stable and predictable performance cost even as NVIDIA's control-flow ISA and reconvergence mechanisms continue to evolve.

IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languages
IndicTalk:面向印度语系的大规模人格化多语言对话语料库
arXiv:2607.23242 LLM 基础设施 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 IndicTalk,目前最大的多语言印度语码混合(code-mixed)会话语料库,包含超过 13,28,604 段事件驱动的多轮对话,覆盖 9 种印度语言的 18 种语言变体,将公开发布以支持低资源印度语多语言会话 AI 的开发与评估。IndicTalk is presented, one of the largest multilingual Indic code-mixed conversational corpora, comprising over 13,28,604 event-grounded multi-turn conversations across 18 language varieties covering 9 Indic languages and will be released to support the development and evaluation of multilingual conversational AI for underrepresented Indic languages.

Reasoning Denoiser: Denoising Reasoning Traces for Hallucination Detection in Large Reasoning Models
Reasoning Denoiser:用于大推理模型幻觉检测的推理轨迹去噪
arXiv:2607.22098 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

RedE 利用 final-answer attention 作为自动监督信号来塑造 step-level 表征空间,使其中的噪声步骤可被可靠识别与过滤,并在检测性能上超越有竞争力的基线。RedE leverages final-answer attention as an automatic supervision signal to shape the step-level representation space, yielding refined embeddings in which noisy steps can be reliably identified and filtered and improves detection performance over competitive baselines.

Codifying the Judge: Scalable Evaluation via Program Distillation
Codifying the Judge:通过程序蒸馏实现可扩展评估
arXiv:2607.22561 评测基准 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 PAJAMA,该系统将程序合成为 judge,将其决策聚合为联合裁决(joint verdict),并通过 fallback 机制选择性地将低置信度用例升级交由 LLM 处理。PAJAMA is introduced, a system that synthesizes programs as judges, aggregates their decisions into a joint verdict, and incorporates a fallback mechanism to selectively escalate low-confidence cases to an LLM.

WorldDiT: A Unified Diffusion Architecture for World and Action Modeling
WorldDiT:面向世界建模与动作建模的统一扩散架构
arXiv:2607.23909 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

WorldDiT 是一种统一的 diffusion Transformer 架构,将动作生成与视觉世界建模耦合,无需大型预训练 VLM 动作主干即取得强性能,在报告全部四个 suite 的方法中,其总模型参数量与平均成功率处于已报告的 Pareto 前沿上。WorldDiT, a unified diffusion transformer architecture that couples action generation with visual world modeling and achieves strong performance without a large pretrained VLM action backbone, lies on the reported Pareto frontier for total model parameters and mean success among methods reporting all four suites.

UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models
UltraViT:面向大视觉-语言模型的端侧延迟优化视觉编码器
arXiv:2607.23373 多模态 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

大量实验表明,结合端上延迟感知设计与定制化训练策略,建立了高效 LVLM 编码的新 SOTA,在端上以近 1.7 倍速度运行的同时显著优于现有以编码器为中心的基线。Extensive experiments demonstrate that the on-device latency-informed design combined with the tailored training strategy establishes a new state-of-the-art for efficient LVLM encoding, significantly outperforming existing encoder-centric baselines while operating on-device at nearly 1.7xthe speed.

A Vocabulary for Multi-Agent Automated Research Systems
多 Agent 自动化研究系统的词汇表
arXiv:2607.22682 Agent 智能体 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出一种面向由一个或多个 agent 构建的自动化研究系统的词汇表,使其设计选择更易于描述与比较,从而将结构性设计问题——例如 agent 应在何时通信、获得或失去某项能力,或在多次运行间传递信息——转化为可测试的选择。A vocabulary for automated research systems built from one or more agents to make their design choices easier to describe and compare, which turns structural design questions, such as when agents should communicate, gain or lose a capability, or carry information across runs, into testable choices.

HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone
HiFi-UMI:仅从高保真 UMI 数据中学习可部署的操控策略
arXiv:2607.25895 工程化 应用落地 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出问题:与其缩减真实机器人数据占比,不如提高无机器人 UMI 数据的保真度,从而在后训练阶段移除该 anchor;并开源 HiFi-UMI,一套面向轨迹精度、夹爪间相对位姿、同步与视场协同设计的便携式 UMI 数据生产系统。It is asked whether raising the fidelity of robot-free UMI data, rather than shrinking the real-robot fraction, can remove that anchor at post-training, and open-source HiFi-UMI, a portable UMI data-production system co-designed for trajectory accuracy, inter-gripper relative pose, synchronization, and field of view.

ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition
ReDesign:通过 Agentic 分解从图像中恢复可编辑的设计结构
arXiv:2607.25565 Agent 智能体 观点 OA · 绿色 被引 1 · S2

本文提出 ReDesign,一种 agentic 框架,通过跨模态选择与组合专用工具来构建可编辑的层级结构(layer hierarchy),在取得强视觉保真度的同时,于布局、颜色与文本编辑上提供最高的可编辑性。ReDesign is presented, an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities, and achieves strong visual fidelity while delivering the highest editability across layout, color, and text edits.