该工作将两步方法的遗憾分解为候选生成遗憾和候选内选择遗憾,并利用最近邻估计器和Transformer的预测误差保证对后者进行了界。This work decomposes the regret of the two-step method into candidate-generation regret and within-candidate choice regret, and bound the latter using prediction-error guarantees for nearest-neighbor estimators and transformers.
论文
111 张论文卡片 · RAG 检索增强 · 方法
研究结果表明,文档表示不应被视为检索开始前一次性的固定预处理选择,而应作为一个明确的优化目标。The results suggest that document representation should not be treated as a fixed preprocessing choice made before retrieval begins, but as an explicit optimization target.
本文提出 IteraSim RAG,一个面向自动化 OpenFOAM 算例生成的 RAG 软件后端,围绕三大局限构建:求解器选择、湍流闭合、边界条件与有限体积默认值。IteraSim RAG is presented, a retrieval-augmented software back-end for automated OpenFOAM case generation built around three limitations: solver selection, turbulence closures, boundary conditions and finite-volume defaults.
该工作发布了 LAMAR,一种具备语言感知能力的多语种 cross encoder,在训练中兼顾语义相关性与语言连贯性,在通用多语种 reranking 基准上整体以及各语言单独评估中均达到最佳性能。This work releases LAMAR, a language aware multilingual cross encoder trained to account for both semantic relevance and language coherence, which achieves the best performance overall and across all languages examined individually on general multilingual reranking benchmarks.
DeCoRAG 是一个多模态 Graph RAG pipeline,将知识处理从耦合的视觉-语义推理转向认知层面的 Decoupling,进而把推理空间从稠密、带噪的背景推向纯净、意图驱动的语义簇。DeCoRAG is a multimodal Graph RAG pipeline that shifts knowledge processing from coupled visual-semantic reasoning to cognitive Decoupling, and subsequently drives the reasoning space from dense, noisy backgrounds to purified, intent-driven semantic clusters.
提出一种面向历史文档修复的新框架,利用搭载 RAG 的大语言模型,有效缓解了推断上下文相关专有名词的难题。A novel framework for historical document restoration that leverages large language models with retrieval-augmented generation (RAG) and effectively mitigates the challenge of inferring context-dependent proper nouns is introduced.
RedE 利用 final-answer attention 作为自动监督信号来塑造 step-level 表征空间,使其中的噪声步骤可被可靠识别与过滤,并在检测性能上超越有竞争力的基线。RedE leverages final-answer attention as an automatic supervision signal to shape the step-level representation space, yielding refined embeddings in which noisy steps can be reliably identified and filtered and improves detection performance over competitive baselines.
本文在由专家级 MITRE Center for Threat-Informed Defense 标注构成的、包含 1,207 条 CVE 的精选 gold 数据集上训练多标签分类器,结果表明该分类器受限于标签质量而非数据规模。A multi-label classifier is trained on a curated gold dataset of 1,207 CVEs from expert MITRE Center for Threat-Informed Defense mappings, indicating that the classifier is limited by label quality rather than dataset size.
本文提出 Kontrast,一种利用 Text-to-SPARQL 与 LLM 推理将基于表格的答案与 KG 证据进行对比并对所产生的不一致性进行分类的自动框架,并表明文本、表格与 KG 可通过系统性对比相互补充与纠错。Kontrast is presented, an automatic framework that uses Text-to-SPARQL and LLM reasoning to compare table-based answers with KG evidence and categorize the resulting inconsistencies, and shows that text, tables, and KGs can complement and correct one another through systematic comparison.
BeyondUncertainty 首先引出结构化的临时答案与置信度估计,然后应用在 held-out 验证数据上选定并在测试评估前冻结的模型特定阈值,揭示了更具选择性的证据获取与端到端 token 效率之间的权衡。BeyondUncertainty first elicits a structured provisional answer and confidence estimate, then applies a model-specific threshold selected on held-out validation data and frozen before test evaluation, revealing a trade-off between more selective evidence acquisition and end-to-end token efficiency.
Temporal-Distance-JEPA 通过发现离线日志中的时间进展结构,并将代价形式与规划时部署协同设计,缩小了 JEPA world-model 规划器的训练-规划差距。Temporal-Distance-JEPA narrows the train--plan gap for JEPA world-model planners by discovering temporal progress structure in offline logs and co-designing cost form with plan-time deployment.
提出 DualG-MRAG,一种面向多模态 RAG 的双层框架,解耦 Macro-reasoning 与 Micro-matching Graph 两类图结构,通过分离全局结构推理与细粒度证据匹配来抑制检索噪声,并引入动态规划解码机制,从 GNN 前向过程中直接提取显式推理路径。DualG-MRAG is proposed, a Dual-tier framework that introduces a decoupled architecture comprising Macro-reasoning and Micro-matching Graphs for Multimodal RAG to suppress retrieval noise by isolating global structural reasoning from fine-grained evidence matching, and introduces a dynamic programming decoding mechanism that extracts explicit reasoning paths directly from the GNN's forward pass.
引入一个基于 GLM 的 retriever,并在单跳与多跳 RAG 场景下对比分析 GLM-based、GNN-based 与传统向量检索 retriever 的相对优势,指出微调后的 GLM retriever 具有更好的跨域泛化能力。This work introduces a GLM-based retriever and investigates the comparative strengths of GLM-based, GNN-based, and traditional vector-search-based retrievers in single- and multi-hop RAG settings, and suggests that finetuned GLM retrievers generalize better out of domain.
提出 ConMem,一个面向 LLM 辅助设备巡检的贡献感知 memory 框架,支持人在环的早期风险筛查,并在受限 memory 预算下保留高价值证据。This work proposes ConMem, a contribution-aware memory framework for LLM-assisted equipment inspection, supporting a human-in-the-loop early-risk screening system and retaining high-value evidence under a constrained memory budget.
OptGraph 是首个引入 GraphRAG 的优化 agentic workflow,首次将可复用经验构建为类型化 graph,刻画建模模式、问题形式化、实现细节与错误修正之间的关系。OptGraph is the first optimization agentic workflow that introduces graph retrieval-augmented generation (GraphRAG) and first constructs reusable experience as a typed graph, capturing the relationships among modeling patterns, problem formalization, implementation details, and error corrections.
提出Hypothetical Prompt Embeddings (HyPE),将假设内容的生成从查询阶段前移到索引阶段,把检索转化为问题-问题匹配任务,无需运行时合成答案生成。This work proposes Hypothetical Prompt Embeddings (HyPE), a framework that shifts the generation of hypothetical content from query time to the indexing phase, and transforms retrieval into a question-question matching task, bypassing the need for runtime synthetic answer generation.
UEmbed (Unified Embedding)是一种decoder-only多模态嵌入模型,在单次因果前向中同时产出稀疏词项与稠密表示,提供新范式:在单一模型中统一稠密与稀疏嵌入,并将稀疏检索扩展以统一文本与多模态输入。UEmbed (Unified Embedding), a decoder-only multimodal embedding model that produces both sparse lexical and dense representations in one causal forward pass, offers a new paradigm: it unifies dense and sparse embeddings in one model, while further extending sparse retrieval to unify text and multimodal inputs.
STAMPlus 解决了超出单目标预测的三难问题,解耦自回归对话与非自回归 mask 预测,取得 SOTA 分割性能,同时保持通用多模态指令遵循能力,并降低 12 类别延迟。STAMPlus resolves the trilemma beyond single-target prediction, decoupling autoregressive dialogue from non-autoregressive mask prediction and achieves state-of-the-art segmentation performance, preserves general multimodal instruction following, and reduces 12-category latency.
贡献一个由欧洲联盟法院 (CJEU) 判决构建的大规模法律 IR 数据集,支持在多个 query-document 层级上开发与严格评估法律 IR 方法。This work contributes a large-scale legal IR dataset constructed from Court of Justice of the European Union (CJEU) judgments, which supports both the development and rigorous evaluation of legal IR methods, at multiple query-document levels.
配对 MEG 掩蔽实验表明,19 个刺激特征中有 15 个有贡献,其中静音、声音强度、元音和声学起始的影响最大;说明缺乏叙事结构的神经活动相比连贯语音下的活动,可恢复的信息更少。Paired MEG occlusion shows that 15 of 19 stimulus features contribute, with the largest effects for silence, sound intensity, vowels, and acoustic onsets, indicating that activity without narrative structure carries less recoverable information than activity during coherent speech.
本工作提出一种通过引入自注意力来提取可解释句子嵌入的新模型,使用一个二维矩阵表示嵌入,其中矩阵的每一行关注句子的不同部分。A new model for extracting an interpretable sentence embedding by introducing self-attention is proposed, which uses a 2-D matrix to represent the embedding, with each row of the matrix attending on a different part of the sentence.
提出 READ(Reliable Embedding-free Agentic Document-search):Agent 通过三种确定性操作——归一化词法搜索、结构导航与有界片段读取——直接读取原始文档,这些操作通过 Model Context Protocol 暴露,使轨迹成为可回放的审计轨迹,而非不透明相似度分数。This work proposes READ (Reliable Embedding-free Agentic Document-search), in which an agent reads the raw document through three deterministic operations -- normalized lexical search, structural navigation, and bounded span reads -- exposed over the Model Context Protocol, so a trajectory is a replayable audit trail, not an opaque similarity score.
本文提出 Atlas,一个经过精心设计并预训练的检索增强大语言模型,能以极少训练样例学习知识密集型任务,并研究了文档索引内容的影响,表明该索引可便捷地更新。This work presents Atlas, a carefully designed and pre-trained retrieval augmented language model able to learn knowledge intensive tasks with very few training examples, and studies the impact of the content of the document index, showing that it can easily be updated.
本文在低 prefill 延迟约束下优化 Pareto 前沿以最大化精度,提出 CoinRAG(Contextualized Information Nugget KV Cache Reuse for Long-Context RAG),通过 chunk 级上下文无缝拼接其切片化的 KV 表示。This paper optimizes the Pareto frontier under low prefill latency constraints while maximizing accuracy by proposing CoinRAG (Contextualized Information Nugget KV Cache Reuse for Long-Context RAG), which seamlessly assembles their sliced KV representations with a chunk-level context.
本文提出 Exact Adaptive Hybrid Retrieval(EAHR),将完整列表加权 RRF 定义的有序 Top-K 固定为检索目标,并将通道深度视为请求特定的执行状态,在全部 150 组 query-snapshot 组合中复现了完整列表的有序 Top-20。This work proposes Exact Adaptive Hybrid Retrieval (EAHR), which fixes the ordered Top-$K$ defined by complete-list weighted RRF as the retrieval target and treats channel depth as request-specific execution state and reproduced the complete-list ordered Top-20 in all 150 query-snapshot combinations.
本文通过深度多模态嵌入视觉与自然语言数据,提出了一种用于图文双向检索的模型,并引入结构化的最大间隔目标,使该模型能够显式地跨模态关联片段。This work introduces a model for bidirectional retrieval of images and sentences through a deep, multi-modal embedding of visual and natural language data and introduces a structured max-margin objective that allows this model to explicitly associate fragments across modalities.
本文利用源自 CNN 的同一基础信息重新审视初始搜索与重排序两个检索阶段,显著改进了现有基于 CNN 的识别流水线。This work revisits both retrieval stages, namely initial search and re-ranking, by employing the same primitive information derived from the CNN, and significantly improves existing CNN-based recognition pipeline.
训练一个紧凑分类器,对被省略的句子按其是否为理解保留文本所必需进行排序,并在推理时无需支撑标注地回插排名靠前的候选,同时优化相关性与指代完整性。A compact classifier is trained to rank omitted sentences by whether they are needed to interpret retained text and reinsert the top-ranked candidates without support annotations at inference, training a compact classifier to optimize both relevance and referential completeness.
本文提出 Factorized Hypothesis Search (FHS),在多个命名语义维度上维护多个部分解释,以支持结构化查询渲染、多假设检索以及维度级候选验证。This work proposes Factorized Hypothesis Search (FHS), which maintains multiple partial interpretations over named semantic dimensions that support structured query rendering, multi-hypothesis retrieval, and dimension-level candidate verification.
本文提出 KGCaRe,一种将神经检索与基于 LLM 生成 KG 的符号推理相结合的混合方法,在 Vanilla LLM、Code Prompt、Text Prompt、Think-on-Graph、Vanilla RAG 和 HybridContextQA 等 baseline 上 consistently 取得更优表现。KGCaRe is proposed, a hybrid approach that combines neural retrieval with symbolic reasoning over LLM-generated KGs that consistently outperforms existing baselines, including Vanilla LLM, Code Prompt, Text Prompt, Think-on-Graph, Vanilla RAG, and HybridContextQA.
本文提出 DistilVDR,一个 524M 的端到端 VDR 系统,通过逐点余弦对齐损失从一个 8B 视觉-语言教师模型进行双向蒸馏,并以非对称的纯编码器学生模型匹配 VDR 的文本查询与图像-文档输入不对称性,将视觉容量集中于文档端,查询端保持 70M 参数。This work presents DistilVDR, a 524M end-to-end VDR system distilled bilaterally from a single 8B vision-language teacher under a pointwise cosine alignment loss and matches VDR's text-query and image-document input asymmetry with an asymmetric encoder-only student that concentrates visual capacity on the document side and keeps the query side at 70M parameters.
本文提出一种自我知识 RAG 框架,引导 LLM 从专利匹配查询中自主提取关键技术实体并构建层次化本体结构,从而实现查询扩展与精确检索。A self-knowledge RAG framework is proposed that guides LLMs to autonomously extract key technical entities and construct hierarchical ontological structures from patent matching queries, thereby enabling query expansion and precise retrieval.
本文提出一种框架,用于从系统描述自动构建 DML 模型并将其表示为知识图谱 (KG-DML),以 RAG 和 LLM 作为使能工具。This study presents a framework for automated construction of DML models from system descriptions and their representation as Knowledge Graphs (KG-DML), using Retrieval-Augmented Generation and Large Language Models as enabling tools.
ParliamentRAG 是一种主题相关的权威模型,根据当前 query 估计每位发言者的权威性,结合职业、教育和此前发言等可解释组件,以应对政治敏感文本中最高频发言者主导、无法按主题专长加权发言者以及引用归属错误的风险。ParliamentRAG is a topic-dependent authority model that estimates each speaker's authority as a function of the current query, combining interpretable components such as profession, education, and previous interventions that addresses risks of dominance of the most frequent speakers, inability to weight speakers according to topical expertise, and citation misattribution in politically sensitive text.
联合部署可将攻击成功率从 67.4% 降至 14.0%,同时在未投毒检索上保留 41.3% 的 F1,证明无需投毒标签或可信语料库即可在语料入库和查询时提供实用的双重保护。Joint deployment reduces attack success from 67.4% to 14.0% while retaining 41.3% F1 on unpoisoned retrieval, demonstrating practical protection at both corpus ingestion and query time without poison labels or trusted corpora.
对八个法律 RAG 系统在 GDPR 和某国国内民法两个法律语料上的幻觉行为进行细粒度分析,发现含有错误假设的 false-premise 问题在人工编写问题上产生高幻觉率。A fine-grained analysis of hallucination behavior in eight legal RAG systems across two legal corpora, the GDPR and a national civil law, finds that false-premise questions, containing incorrect assumptions that must be rejected, produce high hallucination rates on the manually-drafted questions.