HERA 是一个分层框架,联合演化多 Agent 编排与角色特定的 Agent prompt,在多 Agent RAG 中实现针对性的、角色条件化的改进,并提供角色感知的 prompt 演化。HERA is a hierarchical framework that jointly evolves multi-agent orchestration and role-specific agent prompts, enabling targeted, role-conditioned improvements in multi-agent Retrieval-Augmented Generation and Role-Aware Prompt Evolution.
论文
134 张论文卡片
本文在 KV cache 约束下对 LLM 推理进行理论建模,提出一种新型批处理与调度算法,在有效管理 KV cache 内存的同时最小化推理延迟,并通过在合成数据集上与后视最优的对比展示其强劲的实证性能。This work model LLM inference with KV cache constraints theoretically and proposes a novel batching and scheduling algorithm that minimizes inference latency while effectively managing the KV cache's memory, and demonstrates the algorithm's strong empirical performance by comparing it to the hindsight optimal in a synthetic dataset.
本文构建一种针对 GitHub issue 的持久会话评估方法,锚定在单一 base commit,对线性顺序探索与非线性、领域范围的并行 agentic 探索进行比较。This work constructs an approach for persistent-session evaluation of GitHub issues anchored at a single base commit, and compares linear sequential exploration against non-linear, domain-scoped parallel agentic exploration.
文中指出,安全的 LLM Agent 需要显式的信任边界、原则化的权限控制、具备溯源能力的 state 管理,以及与真实运行场景对齐的评估实践;现有 benchmark 仍未能充分覆盖长程、具状态、对部署敏感的风险。It is argued that secure LLM agents require explicit trust boundaries, principled privilege control, provenance-aware state management, and evaluation practices aligned with realistic operational settings, as well as existing benchmarks still underrepresent long-horizon, stateful, and deployment-sensitive risks.
文中认为,编码 Agent 已跨越能力门槛,传统的人工 code review 已不再是软件质量流水线的必要环节。It is argued that coding agents have crossed a threshold of capability at which traditional human code review is no longer a necessary component of a software quality pipeline.
在 DeNovoSWE 上对 Qwen3-30B-A3B 进行微调可显著提升长程 SWE 性能,在具有挑战性的 BeyondSWE-Doc2Repo benchmark 上将其得分从 5.8% 提升至 47.2%。Fine-tuning Qwen3-30B-A3B on DeNovoSWE substantially improves long-horizon SWE performance, raising its score on the challenging BeyondSWE-Doc2Repo benchmark from 5.8% to 47.2%.
本综述系统梳理了超越基础 Skill 创建的 Skill 演化与评估图景,将其归纳为四种范式:执行反馈、轨迹蒸馏、压缩与强化学习,并指出了构建可泛化、高效且可验证安全的 Skill 生态的开放方向。This survey systematically examines the landscape of skill evolution and evaluation beyond foundational skill creation into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, and identifies open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe.
该方法通过在现有企业搜索基础设施之上叠加一层轻量级 harness,为推理型 LLM 配备 search、find、open、summarize 等工具,使其能够自主地迭代检索信息、跨文档导航并分析证据,从而降低对单一环节的过度依赖。The approach reduces this overdependence by layering a lightweight harness on top of existing enterprise search infrastructure, equipping a reasoning LLM with search, find, open, and summarize tools enabling the model to iteratively retrieve information, navigate within documents, and analyze evidence autonomously.
本文提出了一种实证方法,用于研究基于 GPU 的 LLM 推理服务系统中的 software aging 问题,并提供了一个可复现的框架,开辟了 software aging 与 software rejuvenation 与 LLM serving 交叉方向的研究。This paper proposes an empirical methodology to study software aging in GPU-based LLM serving systems and provides a reproducible framework that opens a research direction at the intersection of the software aging and rejuvenation and LLM serving communities.
分析表明,鲁棒的长期记忆(Long-Term Memory)安全无法仅在 retrieval 或执行阶段后置加固,而必须在最初就以存储阶段的溯源、版本化与策略感知的 retention 为基础进行锚定。This analysis indicates that robust Long-Term Memory security cannot be retrofitted at retrieval or execution time alone, but must be anchored in storage-time provenance, versioning, and policy-aware retention from the outset.
本文推出 STEP3-VL-10B,一个面向"紧凑效率与前沿级多模态智能"权衡的轻量级开源基础模型,并发布完整模型套件,为社区提供强大、高效且可复现的 baseline。STEP3-VL-10B is presented, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence, and the full model suite is released to provide the community with a powerful, efficient, and reproducible baseline.
本文概述了第二届 MAGMaR(Multimodal Retrieval 驱动的多模态增强生成)研讨会共享任务的成果,参赛系统聚焦于视频检索,或在给定检索视频的基础上进行有依据的文章生成。This overview paper presents the results of the shared task for the second workshop on Multimodal Augmented Generation via Multimodal Retrieval (MAGMaR), where participants submitted systems focused on either video retrieval or grounded generation of articles given retrieved videos.
文章认为基于实体的分解能形成对原始信息更精炼的表示,并有助于降低索引与生成过程中的噪声;在端到端 QA 评测中,VectorRAG 表现优于标准 GraphRAG,且接近当前 SOTA 图方法的效果。It is argued that entity-based decomposition yields a more distilled representation of original information, and additionally serves to reduce noise in the indexing, and generation process, and on end to end QA evaluation VectorRAG performs better than standard GraphRAG and almost as good as current SOTA graph-based solutions.
提出 SIFT:Selective-Index For Fast Compute of RAG Prefill by Exploiting Attention Invariance,离线处理文档并提取每个文档中高分注意力的细粒度位置,以两个紧凑的位向量存储这些高分位置。SIFT: Selective-Index For Fast Compute of RAG Prefill by Exploiting Attention Invariance is proposed, which processes documents offline and extracts fine-grained locations of high attention scores for each document and stores locations of high scores in the form of two compact bit vectors.
本综述界定了 CAIS 的概念,提出基于组件角色与编排策略的多维分类体系,并分析四种基础范式:Retrieval-Augmented Generation (RAG)、LLM Agents、Multimodal LLMs (MLLMs) 与 Orchestration。This survey defines the concept of CAIS, proposes a multi-dimensional taxonomy based on component roles and orchestration strategies, and analyzes four foundational paradigms: Retrieval-Augmented Generation (RAG), LLM Agents, Multimodal LLMs (MLLMs), and Orchestration.
本文围绕形式化框架与 Agent 生命周期,对面向 LLM-based Agent 的文本世界模型进行系统性综述,旨在整合这一快速发展的方向、厘清其设计空间,并指出未来研究的开放挑战。This work systematically review text world models for LLM-based agents, organized around a formal framework and the agent lifecycle, and aims to consolidate this rapidly developing area, clarify its design space, and highlight open challenges for future research.
本综述为 LLM Agent 记忆机制提出一种新的演化框架,将发展过程形式化为三个阶段:Storage(轨迹保存)、Reflection(轨迹精炼)与 Experience(轨迹抽象)。This survey proposes a novel evolutionary framework for LLM agent memory mechanisms, formalizing the development process into three stages: Storage (trajectory preservation), Reflection (trajectory refinement), and Experience (trajectory abstraction).
介绍 EvoArena 基准套件,将环境变化建模为跨终端、软件与社会领域的渐进式更新序列;并提出 EvoMem,一种基于 patch 的记忆范式,将记忆演化记录为结构化的更新历史,使 Agent 能通过记忆的变化推理环境的演化。EvoArena is introduced, a benchmark suite that models environment changes as sequences of progressive updates across terminal, software, and social domains, and EvoMem is proposed, a patch-based memory paradigm that records memory evolution as structured update histories, enabling agents to reason about environmental evolution through changes in their memory.
本文提出 Beyond Rows to Reasoning (BRTR),一种面向电子表格理解的多模态 Agentic 框架,将单轮检索替换为迭代式工具调用循环,支持从复杂分析到结构化编辑的端到端 Excel 工作流。This work introduces Beyond Rows to Reasoning (BRTR), a multimodal agentic framework for spreadsheet understanding that replaces single-pass retrieval with an iterative tool-calling loop, supporting end-to-end Excel workflows from complex analysis to structured editing.
介绍 Corpus2Skill:离线将文档语料蒸馏为分层 Skill 目录,服务时由 LLM Agent 自顶向下导航——从全局概览逐层深入到更细粒度的摘要再到具体文档,并在分支无效时回溯。Corpus2Skill is presented, which distills a document corpus offline into a hierarchical skill directory and lets an LLM agent navigate it at serve time, drilling from a bird's-eye view through progressively finer summaries down to documents, and backtracking when a branch is unproductive.
介绍 MCP-Persona,这是首个专为评估 Agent 在真实场景、个性化 MCP 工具上的表现而设计的基准,并揭示了当前 Agent 在个性化工具使用上的显著不足,从而凸显该基准在发现并解决这些局限上的关键作用。MCP-Persona is introduced, the first benchmark specifically designed for evaluating agent performance on real-world, personalized MCP tools and demonstrates their significant struggles with personalized tool use, thereby highlighting the benchmark's crucial role in identifying and addressing these limitations.
对八款主流开源 MLOps 框架的实践使用与功能增强需求进行调查,结果显示 MLOps 框架很少被直接开箱即用,也较少集成进 GitHub Workflows,开发者更多通过其 API 在项目中实现自定义功能。Investigating the practical use and desired feature enhancements of eight popular open-source MLOps frameworks indicates that users mainly ask for enhancements to core features of the frameworks, but also better API exposure and CI/CD integration.
对聚焦MLOps工具的学术文献进行系统综述,揭示其功能、范围及其旨在解决的挑战,并突出真实MLOps pipeline中各工具间互操作性的重要性。A systematic review of the academic literature focused on MLOps tools is conducted to reveal their function, scope, and the challenges they are designed to address and highlight the importance of interoperability across MLOps tools in real-world MLOps pipelines.
本研究对基于RAG的系统与工具增强的LLM Agent进行系统对比,特别是在Agent仅可访问基础关键词搜索工具的条件下,评估二者的检索机制与响应质量。This study conducted a systematic comparison between RAG-based systems and tool-augmented LLM agents, specifically evaluating their retrieval mechanisms and response quality when the agent only has access to basic keyword search tools.
本文主张将这些多样化的功能统一在单一抽象与一组通用计算原语之下,使其足够强大以涵盖现有用例并支持新用例。This paper argues for unifying these diverse functionalities under a single abstraction and a common set of computational primitives, powerful enough to encompass existing use cases and to support new ones.
本文给出一份关于Agentic RAG系统的分析综述,梳理RAG范式的演进,提出基于Agent数量、控制结构、自主性与知识表示的Agentic RAG架构分类法,并对现有框架的设计权衡进行比较分析。An analytical survey of Agentic RAG systems is presented, which traces the evolution of RAG paradigms, introduces a principled taxonomy of Agentic RAG architectures based on agent cardinality, control structure, autonomy, and knowledge representation, and provides a comparative analysis of design trade-offs across existing frameworks.
本文提出FROAV(Framework for RAG Observation and Agent Verification),一个通过提供即插即用架构——结合可视化工作流编排、综合性评估框架与可扩展Python集成——来降低LLM Agent研究门槛的开源研究平台。FROAV (Framework for RAG Observation and Agent Verification), an open-source research platform that democratizes LLM agent research by providing a plug-and-play architecture combining visual workflow orchestration, a comprehensive evaluation framework, and extensible Python integration, is presented.
本文分析了六个公共注册表中共计67,057个服务器,识别出可导致服务器劫持与调用操控的普遍隐患,并实现了MCPInspect——一款集成前分析工具,可检测误导性的工具元数据与可利用的代码漏洞。This paper analyzes 67,057 servers across six public registries and identifies widespread conditions enabling server hijacking and invocation manipulation, and implements MCPInspect, a pre-integration analysis tool that detects misleading tool metadata and exploitable code vulnerabilities.
本文提出三种协议级原语以填补Model Context Protocol的空白:身份传递、自适应工具预算与结构化错误语义,并提出Structured Error Recovery Framework (SERF),提供机器可读的失败语义以支持确定性的Agent自校正。Three protocol-level primitives are proposed to fill gaps in the Model Context Protocol: identity propagation, adaptive tool budgeting, and structured error semantics, and the Structured Error Recovery Framework (SERF), which provides machine-readable failure semantics that enable deterministic agent self-correction.
性能评估显示,新训练的深度 CNN 模型 SentiBank 2.0(即 DeepSentiBank)在标注准确率与检索性能上较此前主要采用二分类 SVM 的版本有显著提升。Performance evaluation shows the newly trained deep CNNs model SentiBank 2.0 (or called DeepSentiBank) is significantly improved in both annotation accuracy and retrieval performance, compared to its predecessors which mainly use binary SVM classification models.
本文提出TSseek,一个面向分布式时间序列数据集的正则表达式驱动搜索框架,并论证传统近似技术及其索引结构因无法作用于正则表达式查询构造而不适用于此类查询。This work proposes TSseek, a regular-expression-powered search framework for distributed time series datasets, and shows that conventional approximation techniques and their index structures are ill-suited for such queries because they cannot operate on regular-expression query constructs.
研究表明矛盾解析本质上是写入时并发控制,并将缺失的契约——一个在隔离性、模式与来源维度上被证明正确的写入时正确性规范——显式化,固定了每个生产启发式都默认假设、却没有任何已部署系统显式给出的保证。It is shown that contradiction resolution is write-time concurrency control and make the missing contract explicit, a write-time correctness specification, proved sound across isolation, schema, and provenance, pinning the guarantee every production heuristic assumes but no deployed system makes explicit.
本文提出Larch,一个用于优化AI SQL查询中语义过滤器执行的框架,并给出其两种变体:Larch-A2C与Larch-Sel,二者在token使用量上均始终优于现有语义过滤器优化技术。This paper introduces Larch, a framework for optimizing the execution of semantic filters in AI SQL queries and presents two Larch variants: Larch-A2C and Larch-Sel, which always outperform existing semantic filter optimization techniques in terms of token usage.
实验表明,DataEvolver 显著提升了数据质量,相比在原始数据上训练,下游 LLM 性能平均提升 10%,凸显了 LLM 与数据迭代协同演化的新机遇。Experiments show that DataEvolver substantially improves data quality and achieves an average 10\% gain in downstream LLM performance compared with training on original data, highlighting new opportunities for the iterative co-evolution of LLMs and data.
Bespoke-Card 在传统通用估计器与学习型估计器架构之外开辟了一条新的基数估计路径,它是一个 Agent 驱动的系统,将面向特定工作负载的基数估计器合成为可执行代码。Bespoke-Card is opening a new avenue for cardinality estimation next to classical generic estimators and learned estimator architectures, an agent-driven system that synthesizes workload-specific cardinality estimators as executable code.