Papers · organized/paper_cards

论文

711 张论文卡片 · 方法

开放获取 全部 绿色 · 724
When Privileged Guidance Misaligns: State-Matched Routing and Contextualized Self-Distillation for Multi-Turn Agents
特权引导失配时:面向多轮 Agent 的状态匹配路由与情境化自蒸馏
arXiv:2608.05219 Agent 智能体 方法 被引 0 · S2

SMRC-SD(State-Matched Routing and Contextualized Self-Distillation)显式地决定特权轨迹应在何时、以何种方式指导 on-policy student,其表现始终优于无条件的成功全路径蒸馏。State-Matched Routing and Contextualized Self-Distillation (SMRC-SD), which explicitly determines when and how a privileged trajectory should guide an on-policy student, consistently outperforms unconditional successful full-path distillation.

CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG
CoinRAG:面向长上下文 RAG 的上下文信息要点 KV 缓存复用
arXiv:2608.07458 RAG 检索增强 方法 被引 0 · S2

本文在低 prefill 延迟约束下优化 Pareto 前沿以最大化精度,提出 CoinRAG(Contextualized Information Nugget KV Cache Reuse for Long-Context RAG),通过 chunk 级上下文无缝拼接其切片化的 KV 表示。This paper optimizes the Pareto frontier under low prefill latency constraints while maximizing accuracy by proposing CoinRAG (Contextualized Information Nugget KV Cache Reuse for Long-Context RAG), which seamlessly assembles their sliced KV representations with a chunk-level context.

Exact Adaptive Hybrid Retrieval Without Fixed Top-L Cutoffs
无固定 Top-L 截断的精确自适应混合检索
arXiv:2608.07152 RAG 检索增强 方法 被引 1 · S2

本文提出 Exact Adaptive Hybrid Retrieval(EAHR),将完整列表加权 RRF 定义的有序 Top-K 固定为检索目标,并将通道深度视为请求特定的执行状态,在全部 150 组 query-snapshot 组合中复现了完整列表的有序 Top-20。This work proposes Exact Adaptive Hybrid Retrieval (EAHR), which fixes the ordered Top-$K$ defined by complete-list weighted RRF as the retrieval target and treats channel depth as request-specific execution state and reproduced the complete-list ordered Top-20 in all 150 query-snapshot combinations.

When Activation Oracles Learn Not to Read: Concept-Specific Blind Spots in Fine-Tuned Oracles
当激活预言机学会不去读取:微调预言机中的概念特定盲区
arXiv:2607.23379 工程化 方法 被引 1 · S2

研究发现,微调后的 AO 可能变成概念特异的 anti-reader:它们会选择性地无法恢复自身训练过程中持续存在的概念,从而对习得的可解释性接口提出可靠性担忧。It is found that fine-tuned AOs can become concept-specific anti-readers: they selectively fail to recover the concept persistently present during their own training, raising a reliability concern for learned interpretability interfaces.

Deep Fragment Embeddings for Bidirectional Image Sentence Mapping
用于双向图文映射的深度片段嵌入
arXiv:1406.5679 RAG 检索增强 方法 OA · 绿色 被引 982 · S2

本文通过深度多模态嵌入视觉与自然语言数据,提出了一种用于图文双向检索的模型,并引入结构化的最大间隔目标,使该模型能够显式地跨模态关联片段。This work introduces a model for bidirectional retrieval of images and sentences through a deep, multi-modal embedding of visual and natural language data and introduces a structured max-margin objective that allows this model to explicitly associate fragments across modalities.

LaMDA: Language Models for Dialog Applications
LaMDA:用于对话应用的语言模型
arXiv:2201.08239 LLM 基础设施 方法 OA · 绿色 被引 1907 · S2

论文证明,使用标注数据进行微调,并允许模型查询外部知识源,能够在安全性和事实性这两个关键挑战上带来显著提升。It is demonstrated that fine-tuning with annotated data and enabling the model to consult external knowledge sources can lead to significant improvements towards the two key challenges of safety and factual grounding.

Particular object retrieval with integral max-pooling of CNN activations
基于 CNN 激活积分最大池化的特定物体检索
arXiv:1511.05879 RAG 检索增强 方法 OA · 绿色 被引 1027 · S2

本文利用源自 CNN 的同一基础信息重新审视初始搜索与重排序两个检索阶段,显著改进了现有基于 CNN 的识别流水线。This work revisits both retrieval stages, namely initial search and re-ranking, by employing the same primitive information derived from the CNN, and significantly improves existing CNN-based recognition pipeline.

Diffusion-Convolutional Neural Networks
扩散卷积神经网络
arXiv:1511.02136 多模态 方法 OA · 绿色 被引 1379 · S2

通过引入扩散卷积运算,本文展示了如何从图结构数据中学习基于扩散的表示,并将其作为节点分类的有效基础。Through the introduction of a diffusion-convolution operation, it is shown how diffusion-based representations can be learned from graph-structured data and used as an effective basis for node classification.

Manifold Mixup: Better Representations by Interpolating Hidden States
Manifold Mixup:通过插值隐藏状态获得更好的表示
arXiv:1806.05236 工程化 方法 OA · 绿色 被引 478 · OpenAlex

Manifold Mixup 在监督学习、对单步对抗攻击的鲁棒性、半监督学习以及留出样本的负对数似然(NLL)上,相较强基线均取得了大幅提升。Manifold Mixup achieves large improvements over strong baselines in supervised learning, robustness to single-step adversarial attacks, semi-supervised learning, and Negative Log-Likelihood on held out samples.

Florence: A New Foundation Model for Computer Vision
Florence:面向计算机视觉的新基础模型
arXiv:2111.11432 多模态 方法 OA · 绿色 被引 1152 · S2

本文提出新的计算机视觉基础模型 Florence,通过融入来自 Web 规模图文数据的通用视觉-语言表示,将表征范围从粗粒度(场景)扩展到细粒度、从静态(图像)扩展到动态(视频)、从 RGB 扩展到多种模态(描述、深度等)。This work introduces a new computer vision foundation model, Florence, to expand the representations from coarse (scene) to fine, from static (images) to dynamic (videos), and from RGB to multiple modalities (caption, depth), by incorporating universal visual-language representations from Web-scale image-text data.

Invariant Risk Minimization
不变风险最小化
arXiv:1907.02893 安全与风险 方法 OA · 绿色 被引 2944 · S2

本文提出了不变风险最小化(IRM),一种用于在多个训练分布上估计不变相关性的学习范式,并展示了 IRM 学到的不变性如何与数据的因果结构相关,从而实现分布外泛化。This work introduces Invariant Risk Minimization, a learning paradigm to estimate invariant correlations across multiple training distributions and shows how the invariances learned by IRM relate to the causal structures governing the data and enable out-of-distribution generalization.

Big Bird: Transformers for Longer Sequences
Big Bird: 用于更长序列的 Transformer
arXiv:2007.14062 LLM 基础设施 方法 OA · 绿色 被引 3043 · S2

研究表明 BigBird 是序列函数的通用逼近器,且具备图灵完备性,从而保留了二次全注意力模型的这些性质。It is shown that BigBird is a universal approximator of sequence functions and is Turing complete, thereby preserving these properties of the quadratic, full attention model.

Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control
Enfold:将世界模型想象折叠进预测表征以实现超高效具身控制
arXiv:2607.26657 多模态 方法 被引 0 · S2

本文提出 Enfold,将构建未来的计算转移到由当前视觉上下文和语言指令预测出的表征中,并把世界生成器重塑为预测控制表征的来源,前提是其内部结构可被折叠(enfold)到当下。This work presents Enfold, which transfers this computation that constructs a future into a representation predicted from the current visual context and language instruction, and recast a world generator as a source of predictive control representations if its internal structure can be enfolded into the present.

Relevant but Incomplete: Referential Dangling as a Paradigm-Level Failure Mode in Hard Prompt Compression
相关但不完整:指代悬空作为硬提示压缩中的范式级失效模式
arXiv:2608.04569 RAG 检索增强 方法 被引 0 · S2

训练一个紧凑分类器,对被省略的句子按其是否为理解保留文本所必需进行排序,并在推理时无需支撑标注地回插排名靠前的候选,同时优化相关性与指代完整性。A compact classifier is trained to rank omitted sentences by whether they are needed to interpret retained text and reinsert the top-ranked candidates without support annotations at inference, training a compact classifier to optimize both relevance and referential completeness.

Complementary Matrix-Gated QKAN Fast-Weight Programmers for Quantum Dynamics Forecasting
用于量子动力学预测的互补矩阵门控 QKAN 快权重编程器
arXiv:2607.27945 评测基准 方法 被引 0 · S2

本文提出 Self-Modulating QKAN-based FWPs,用低秩生成的逐元素调制(作用于新提案分支、有界旧状态分支或两者)替代该广播门,并提出 Complementary Matrix Gating (CMG),在保持标量门控的有界凸更新和仿射前缀扫描结构的同时提供逐坐标的记忆控制。This work introduces Self-Modulating QKAN-based FWPs, which replace this broadcast gate with low-rank-generated element-wise modulation of the new-proposal branch, a bounded old-state branch, or both, and proposes Complementary Matrix Gating (CMG), which provides coordinate-wise memory control while preserving the bounded convex update and affine prefix-scan structure of scalar gating.

DuplexGen: Adaptive Synthesis of Human-AI Turn-Taking Dialogues
DuplexGen:自适应合成人-AI 轮替对话
arXiv:2607.26178 多模态 方法 被引 0 · S2

本文提出 DuplexGen,一个通过少量 slot 级人类偏好标注对 LLM 预测进行校准从而生成具有场景自适应轮换特性的对话框架;结果表明,使轮换合成具备场景特异性的关键是人类校准,而非单纯的语料规模或提示设计。DuplexGen is introduced, a framework for generating dialogues with scenario-adaptive turn-taking by calibrating LLM predictions against a small set of slot-level human preference annotations, and results show that human calibration, not corpus scale or prompt design alone, is what allows turn-taking synthesis to be scenario-specific.

RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance
RynnValue:通过时间距离扩展机器人价值基础模型
arXiv:2608.09853 多模态 方法 被引 1 · S2

RynnValue 是一个用于机器人操控的开源价值基础模型,用时间距离(即从观测到语言指定目标的有向 cost-to-go)替代任务内部锚点,将时间距离确立为通用机器人策略的可扩展监督目标和实用奖励接口。RynnValue, an open-source value foundation model for robotic manipulation that replaces task-internal anchors with temporal distance, the directed cost-to-go from an observation to the language-specified goal, establishes temporal distance as a scalable supervision target and practical reward interface for generalist robot policies.

Ouroboros: A Self-Developing Frontier Coding Agent with Reviewed Core Evolution
Ouroboros:基于已评审核心演化的自进化前沿编程 Agent
arXiv:2608.08311 Agent 智能体 方法 被引 1 · S2

我们提出 Ouroboros,一个自进化的 Agent harness,其工具、提示、上下文组装与核心实现通过已评审的 commit 持续改进,并成为后续工作的运行时。核心演化以两种模式推进:在递归自由演化中,改进本身就是任务,完成一个演化周期即可调度下一周期;在经验驱动核心演化中,常规工作和社交交互暴露的 bug、粗糙之处及低效上下文构造会引发已评审的结构变更。在 Terminal-Bench 2.1 上,Opus 5 运行取得 86.74% 的得分,为该基准报告的最佳结果。We present Ouroboros, a self-developing agent harness whose tools, prompts, context assembly, and core implementation improve through reviewed commits that become the runtime for later work. Core evolution proceeds in two modes. In recursive free evolution, improvement is itself a task, and completing one evolution cycle can schedule the next. In experience-driven core evolution, ordinary work and social interaction expose bugs, rough edges, and inefficient context construction that lead to reviewed structural changes. On Terminal-Bench 2.1, an Opus 5 run scores 86.74%, the best result reporte

OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
OasisKV:通过 Lookahead 稀疏预取将解码端 KV Cache 扩展至 HBM 之外
arXiv:2608.08097 LLM 基础设施 方法 被引 0 · S2

本文提出 OasisKV,一种以显存为中心的 LLM 推理系统设计,通过在 LLM 解码期间将完整 KV-cache 存储与 HBM 解耦来缓解 HBM 容量压力,并观察到未来重要 token 可借助推测解码(SD)所起草的前瞻 token 被提前准确预测。OasisKV is presented, a memory-centric LLM inference system design that alleviates HBM capacity pressure by decoupling full KV-cache storage from HBM during LLM decoding and observes that future important tokens can be predicted accurately in advance using lookahead tokens drafted by speculative decoding (SD).

Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
Agent 记忆蒸馏:通过层级教师记忆赋能小型 LLM Agent
arXiv:2608.07169 Agent 智能体 方法 被引 0 · S2

本文提出 Agent Memory Distillation (AMD),一个无需训练、通过分层记忆将结构化知识从大型教师智能体迁移到小型学生智能体的框架,一致优于现有基于记忆的基线方法。Agent Memory Distillation (AMD), a training-free framework that transfers structured knowledge from a large teacher agent to a small student agent through hierarchical memory, is proposed, which consistently outperforms existing memory-based baselines.

Scaling Inherently Interpretable Language Models
规模化天生可解释的语言模型
arXiv:2608.07594 多模态 方法 被引 2 · S2

Steerling-8B 在与训练计算量多 2–16 倍的开源同侪模型对比中仍保持竞争力,表明存在一种不同的可扩展范式:可解释性可以被设计进训练过程中,并随规模放大而提升。Steerling-8B remains competitive with open peer models trained on substantially 2-16x more compute, suggesting a different scaling paradigm: interpretability can be designed into training, and it improves with scale.

Factorized Hypothesis Search for Evidence-to-Taxonomy Retrieval
分解假设搜索用于证据到分类体系的检索
arXiv:2608.06614 RAG 检索增强 方法 被引 0 · S2

本文提出 Factorized Hypothesis Search (FHS),在多个命名语义维度上维护多个部分解释,以支持结构化查询渲染、多假设检索以及维度级候选验证。This work proposes Factorized Hypothesis Search (FHS), which maintains multiple partial interpretations over named semantic dimensions that support structured query rendering, multi-hypothesis retrieval, and dimension-level candidate verification.

What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems
下一步编辑什么:对话系统中视觉对齐的图像编辑后续建议
arXiv:2608.07565 多模态 方法 被引 0 · S2

一个三阶段框架,用于减少建议编辑与当前图像之间的视觉不一致性,并将推荐 CTR、图像带走率以及用户平均对话轮次分别显著提升 39.90%(所有 p<0.05)。A three-stage framework to reduce visual inconsistencies between suggested edits and the current image, which significantly improves recommendation CTR, image take-away rate, and average conversation turns per user by 39.90% (all p<0.05).

BDH-CQ: In-Context Learning with Recurrent Latent Reasoning
BDH-CQ:基于循环潜变量推理的上下文学习
arXiv:2608.09888 评测基准 方法 被引 0 · S2

本文提出 BDH-CQ,一个结合上下文学习与循环潜在推理的推理模型,通过在高维潜在空间中的迭代计算来求解查询,且无需将中间推理外化为语言。BDH-CQ is introduced, a reasoning model that combines in-context learning with recurrent latent reasoning that solves a query through iterative computation in a high-dimensional latent space, without verbalizing its intermediate reasoning.

Stealing Reasoning Traces from Proprietary LLM APIs
从商用 LLM API 窃取推理轨迹
arXiv:2608.09867 安全与风险 方法 被引 2 · S2

本文识别出一种绕过 anti-distillation 机制、允许攻击者窃取专有模型推理能力的架构漏洞,并提出具体的密码学与系统级缓解措施以保障客户端推理安全。An architectural vulnerability is identified that circumvents anti-distillation mechanisms, allowing adversaries to extract a proprietary model's reasoning, as well as proposing concrete cryptographic and system-level mitigations to secure client-side reasoning.

Ego-OSCAR: Egocentric Open source Stereo CAptuRe System
Ego-OSCAR:自我中心开源立体捕获系统
arXiv:2608.08285 多模态 方法 被引 0 · S2

本文提出 Ego-OSCAR,一种用于野外自我中心数据采集的开源硬件、低成本、头戴式立体惯性采集设备,旨在成为众包自我中心采集中最廉价且可辩护的载体,降低任何团队大规模采集自我中心数据的启动门槛。Ego-OSCAR is presented, an open-hardware, low-cost, head-mounted stereo-inertial capture device for egocentric data collection in the wild that aims to be the cheapest defensible substrate for crowdsourced egocentric capture, and to lower the activation energy for any team that wants to collect egocentric data at scale.

Vision-Language Grounding as Bidirectional Concept Correspondence
视觉-语言接地作为双向概念对应
arXiv:2608.07886 多模态 方法 被引 0 · S2

该形式化方法将短语定位、指代表达定位以及开放词汇检测等常见 grounding 任务统一起来,将文本分割、图像分割以及跨模态对齐视为单一的对应预测问题。This formulation unifies common grounding tasks, including phrase grounding, referring expression grounding, and open-vocabulary detection, by treating text segmentation, image segmentation, and cross-modal alignment as a single correspondence prediction problem.

The Loss Does Not See the Basis, but Adam Does
损失看不到基底,但 Adam 可以
arXiv:2608.05136 LLM 基础设施 方法 被引 0 · S2

一个结构定理将无记忆等变规则刻画为恰好由 Gram 矩阵决定的左预处理子;一个迁移定理将梯度流的路径性质推广到 common-scalar 流。A structure theorem characterizes the memoryless equivariant rules as exactly the Gram-determined left preconditioners, and a transfer theorem carries gradient flow's pathwise properties to common-scalar flows.

Gated Graph Sequence Neural Networks
门控图序列神经网络
arXiv:1511.05493 LLM 基础设施 方法 OA · 绿色 被引 3671 · S2

本工作研究图结构输入的特征学习技术,并在程序验证任务上取得 SOTA 性能,该任务需将子图与抽象数据结构进行匹配。This work studies feature learning techniques for graph-structured inputs and achieves state-of-the-art performance on a problem from program verification, in which subgraphs need to be matched to abstract data structures.

KGCaRe: Explainable Complex Conditional Question Answering using Automatic Knowledge Graph Construction and Context Retrieval with LLMs
KGCaRe:利用 LLM 进行自动知识图谱构建与上下文检索的可解释复杂条件问答
arXiv:2608.09779 RAG 检索增强 方法 被引 0 · S2

本文提出 KGCaRe,一种将神经检索与基于 LLM 生成 KG 的符号推理相结合的混合方法,在 Vanilla LLM、Code Prompt、Text Prompt、Think-on-Graph、Vanilla RAG 和 HybridContextQA 等 baseline 上 consistently 取得更优表现。KGCaRe is proposed, a hybrid approach that combines neural retrieval with symbolic reasoning over LLM-generated KGs that consistently outperforms existing baselines, including Vanilla LLM, Code Prompt, Text Prompt, Think-on-Graph, Vanilla RAG, and HybridContextQA.

Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation
Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation
arXiv:2608.06751 多模态 方法 被引 0 · S2

Atelier 是一种面向艺术家风格图像生成的捷径感知控制状态规划框架,可提升艺术家级风格保真度,更忠实地保持源结构,并相较提示工程、检索增强与通用 agent 基线大幅减少捷径替换。Atelier, a shortcut-aware control-state planning framework for artist-grounded image generation, improves artist-level style fidelity, preserves source structure more faithfully, and substantially reduces shortcut substitution compared with prompt-engineered, retrieval-augmented, and general-purpose agent baselines.

Omega-S: A Functional Resilience Index for LLM Fine-Tuning
Omega-S: A Functional Resilience Index for LLM Fine-Tuning
arXiv:2608.03887 工程化 方法 被引 0 · S2

本文提出 Omega-S——一种仅由权重矩阵计算得到的即插即用惩罚,无需先前任务数据、无需 Fisher 矩阵、无需保存旧权重副本,且单步开销不足 4%。Omega-S, a drop-in penalty computed from the weight matrix alone, is presented, a drop-in penalty computed from the weight matrix alone that needs no previous-task data, no Fisher matrix and no stored copy of the old weights and adds under 4% to the cost of a step.

ComBodied Agents: a New Paradigm of Human-Centric Agentic AI
ComBodied Agents:以人为本的 Agentic AI 新范式
arXiv:2608.10915 Agent 智能体 方法 被引 0 · S2

本文提出 Combodied Agents——一种以人为中心的范式,借助软件工具、传感器、可穿戴设备、机器人与人工服务作为行动通道而非终极目标,在时间维度上感知、建模、预测并支持个体的人体状态轨迹。Combodied Agents is introduced, a human-centered paradigm that perceives, models, predicts, and supports individual human-state trajectories over time, using software tools, sensors, wearables, robots, and human services as action channels rather than end goals.

AdvFD: Boosting Visual Generation via Adversarial Fr'echet Distance Loss
AdvFD:通过对抗 Fréchet 距离损失提升视觉生成
arXiv:2608.11205 工程化 方法 被引 0 · S2

对抗性 Fréchet 距离 (AdvFD) 用经过校准的对抗性学习表示来补充 FD-Loss 中的静态表示目标,通过对抗方式最大化真实样本与生成样本之间的 Fréchet 差异;同时引入真实特征白化,对尺度与协方差几何进行归一化,从而稳定极小极大优化。Adversarial Fr\'echet Distance (AdvFD), which complements the static representation targets in FD-Loss with a calibrated adversarially learned representation that adversarially maximizes the Fr\'echet discrepancy between real and generated samples, and introduces real-feature whitening, which normalizes its scale and covariance geometry and stabilizes the min--max optimization.

Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation
面向多语言机器翻译的开源大语言模型无参考后训练
arXiv:2608.10812 工程化 方法 被引 0 · S2

本文研究基于开源大语言模型的无参考多语言机器翻译后训练,发现 on-policy 蒸馏能够达到但无法超越结合 checkpoint 插值的强化学习所确立的质量前沿。This work studies reference-free post-training for multilingual machine translation with open large language models and finds that on-policy distillation reaches, but does not surpass, the quality frontier achieved by RL with checkpoint interpolation.

DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation
DistilVDR:通过双学生蒸馏构建紧凑的端到端视觉文档检索器
arXiv:2608.10636 RAG 检索增强 方法 被引 0 · S2

本文提出 DistilVDR,一个 524M 的端到端 VDR 系统,通过逐点余弦对齐损失从一个 8B 视觉-语言教师模型进行双向蒸馏,并以非对称的纯编码器学生模型匹配 VDR 的文本查询与图像-文档输入不对称性,将视觉容量集中于文档端,查询端保持 70M 参数。This work presents DistilVDR, a 524M end-to-end VDR system distilled bilaterally from a single 8B vision-language teacher under a pointwise cosine alignment loss and matches VDR's text-query and image-document input asymmetry with an asymmetric encoder-only student that concentrates visual capacity on the document side and keeps the query side at 70M parameters.