Papers · organized/paper_cards

论文

707 张论文卡片 · 方法

开放获取 全部 绿色 · 724
12. KVP:RL 驱动 KV Cache 驱逐策略
arXiv:2602.10238 LLM 基础设施 方法 Open MIND OA · 绿色 被引 4 · S2

本文提出 KV Policy (KVP),一种仅基于 key 与 value 向量、在预计算生成轨迹上训练的轻量级 per-head RL Agent 框架,证明学习预测未来 token 效用是自适应 KV cache 管理中强大且可扩展的范式。KV Policy (KVP), a framework of lightweight per-head RL agents trained on pre-computed generation traces using only key and value vectors, is introduced, demonstrating that learning to predict future token utility is a powerful and scalable paradigm for adaptive KV cache management.

10. TritonForge: Automated Triton Kernel Optimization (arXiv 2512.09196)
10. TritonForge:自动化 Triton Kernel 优化(arXiv 2512.09196)
arXiv:2512.09196 LLM 基础设施 方法 OA · 绿色 被引 19 · S2

TritonForge 是一个面向自动化 Triton kernel 优化的 profiling 引导框架,融合 kernel 分析、运行时 profiling 与迭代式代码转换以简化优化流程,并为自动化 GPU 性能优化领域的未来研究奠定基础。TritonForge, a profiling-guided framework for automated Triton kernel optimization that integrates kernel analysis, runtime profiling, and iterative code transformation to streamline the optimization process and provides a foundation for future research in automated GPU performance optimization.

10. Cloud Native System for LLM Inference Serving(arXiv 2507.18007)
10. 面向 LLM 推理服务的 Cloud Native 系统(arXiv 2507.18007)
arXiv:2507.18007 LLM 基础设施 方法 OA · 绿色 被引 7 · S2

本文探讨容器化、微服务、动态调度等 Cloud Native 技术如何从根本上提升 LLM 推理服务,并展示 Cloud Native 系统在高需求场景下实现更高效资源分配、降低延迟与提升吞吐的能力。This article explores how Cloud Native technologies, such as containerization, microservices, and dynamic scheduling, can fundamentally improve LLM inference serving and demonstrates how a Cloud Native system enables more efficient resource allocation, reduces latency, and enhances throughput in high-demand scenarios.

1. vLLM Startup Latency: Six-Step Systematic Characterization
1. vLLM 启动延迟:六步式系统化表征
arXiv:2606.07362 LLM 基础设施 方法 OA · 绿色 被引 1 · S2

本文首次对 vLLM 启动延迟进行了详细的性能表征,并构建了一个轻量级分析模型,能够针对给定硬件配置准确预测 vLLM 的启动延迟,为大规模推理环境中的资源规划提供了可操作的指导。This paper presents the first detailed performance characterization of vLLM startup latency and develops a lightweight analytical model that accurately predicts vLLM's startup latency for a given hardware configuration, providing actionable guidance for resource planning in large-scale inference environments.

1. Data Flow Control(DFC):AI Agent 数据安全策略的内核级执行框架
arXiv:2606.05679 安全与风险 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文将数据安全形式化为 provenance monomials 上的聚合谓词,并提出 Passant——一个无需物化 provenance 即可强制执行 DFC 策略的可移植查询重写层。This paper formalizes data safety as aggregate predicates over provenance monomials and presents Passant, a portable query rewriting layer that enforces DFC policies without materializing provenance.

Systems 补充候选
arXiv:2511.02230 Agent 智能体 方法 Open MIND OA · 绿色 被引 38 · S2

Continuum,一个通过为 KV cache 保留引入 TTL 机制来优化多轮 Agent 工作负载任务完成时间的服务系统,能保持多轮连续性,并降低 Agent 工作流的延迟。Continuum, a serving system to optimize job completion time for multi-turn agent workloads by introducing time-to-live mechanism for KV cache retention, preserves multi-turn continuity, and reduces delay for agentic workflows.

Systems 补充候选
arXiv:2606.01751 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

SarseX 模型无关、无需训练,并与 Prefix Cache 兼容,可为多轮对话、检索增强生成 (RAG) 和 Agent 工作流等常见在线服务场景提供统一支持。SarseX is model-agnostic, training-free, and compatible with Prefix Cache, and it provides unified support for common online serving scenarios including multi-round chat, retrieval-augmented generation (RAG), and agent workflows.

Systems 补充候选
arXiv:2606.03910 LLM 基础设施 方法 OA · 绿色 被引 1 · S2

NetKV,一种使用该 oracle 信息的 O(|D|) 每请求贪心策略,其层级排序被证明对过时遥测数据具有鲁棒性;并证明随着上下文长度增长,忽略网络项会使仅缓存感知的调度任意次优。NetKV, the O(|D|) per-request greedy that consumes this oracle, has tier rankings that are provably robust to stale telemetry, and it is proved that ignoring the network term renders cache-aware-only scheduling arbitrarily suboptimal as context length grows.

Systems 补充候选
arXiv:2510.09665 LLM 基础设施 方法 OA · 绿色 被引 124 · S2

本工作提出 LMCACHE,首个也是目前最高效的开源 KV 缓存方案,可将现代 LLM 引擎生成的 KV 缓存从 GPU 显存中提取并存储,并跨引擎和查询共享。This work presents LMCACHE, the first and so far the most efficient open-source KV caching solution, which extracts and stores KV caches generated by modern LLM engines out of the GPU memory and shares them across engines and queries.

Multimodal 补充候选
arXiv:2606.13578 多模态 方法 OA · 绿色 被引 1 · S2

构建了 RoboGenesis,一个基于仿真的工作流与数据引擎,可从原子技能组合配置好的实验工作流,对 rollout 进行验证与过滤,并跨支持的机器人配置导出结构化演示数据。RoboGenesis is built, a simulation-based workflow and data engine that composes configured laboratory workflows from atomic skills, validates and filters rollouts, and exports structured demonstrations across supported robot profiles.

4.2 Reliability 不等于成功率:12 指标拆出 consistency / robustness / predictability / safety
4.2 Reliability 不等于成功率:12 指标拆出 consistency / robustness / predictability / safety(⭐⭐⭐⭐⭐)
arXiv:2602.16666 安全与风险 方法 Open MIND OA · 绿色 被引 45 · S2

本工作提出 12 个具体指标,从一致性、鲁棒性、可预测性和安全性四个关键维度分解 Agent 可靠性,可与传统评估互补,并提供用于分析 Agent 表现、退化与失败方式的工具。This work proposes twelve concrete metrics that decompose agent reliability along four key dimensions: consistency, robustness, predictability, and safety, which complement traditional evaluations while offering tools for reasoning about how agents perform, degrade, and fail.

4.1 LogicalRAG:把 Agentic RAG 的重点从“更重 backend”转向“更强 retrieval control”
arXiv:2605.27123 RAG 检索增强 方法 OA · 绿色 被引 3 · S2

本文提出一个 Agentic RAG 框架,使 LLM 能够使用逻辑表达式构建检索意图,同时将检索后端简化为基于倒排索引的系统,并表明将检索过程锚定在逻辑查询上可显著降低生成响应中的幻觉。This paper proposes an agentic RAG framework that enables LLMs to formulate retrieval intents using logical expressions while simplifying the retrieval backend to an inverted-index-based system, and shows that anchoring the retrieval process in logical queries substantially reduces hallucinations in generated responses.

2.3 本轮补充公开检索
arXiv:2606.14589 Agent 智能体 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文对一个自 2026 年 3 月起持续运行的个人助理 Agent 运行时中的静默失败进行纵向研究,该系统包含约 40 个定时任务、8 个 LLM 提供商、一个工具治理代理以及一个知识库记忆层,由 4,286 个单元测试和 827 项治理检查守护。A longitudinal study of silent failures in a personal-assistant agent runtime in continuous production since March 2026, with roughly 40 scheduled jobs, 8 LLM providers, a tool-governance proxy, and a knowledge-base memory plane, defended by 4,286 unit tests and 827 governance checks is presented.

2.3 本轮补充公开检索
arXiv:2606.14061 Agent 智能体 方法 OA · 绿色 被引 3 · S2

结果表明,纯视觉设置会降低准确率并增加 token 成本,因为 Agent 缺乏足够的符号化细节,需通过重复的视觉查询进行补偿;研究指向一种面向下一代编码 Agent 的实用文本与视觉混合设计。The results show that a strictly vision-only setup degrades accuracy and increases token cost, because agents lack sufficient symbolic detail and compensate with repeated visual queries, and point to a practical hybrid text-and-vision design for next-generation coding agents.

MMAgent-R$^2$: Learning to Rerank and Reject for Agentic mRAG
MMAgent-R$^2$:面向 Agentic mRAG 的重排序与拒答学习
arXiv:2607.07383 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 MMAgent-R$^2$,一种将视觉重排序与主动拒答作为内部验证机制的 Agentic mRAG 框架,并通过 GRPO 训练实现外部检索、内部验证与答案生成的联合优化。MMAgent-R$^2$, an agentic mRAG framework that integrates visual reranking and active rejection as its internal verification mechanism, is proposed and achieves joint optimization of external retrieval, internal verification, and answer generation via GRPO training.

Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering
问答中面向自适应检索与推理的可解释不确定性
arXiv:2607.07380 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出一种基于不确定性感知框架的自适应问答方法,通过 LLM 内部表征中区分知识不足与知识歧义/冲突的显式信号,在单次前向传播中即可由隐状态高效估计。This work proposes an uncertainty-aware framework for adaptive QA based on explicit signals derived from LLM internal representations that distinguish between knowledge insufficiency and knowledge ambiguity or conflict, and efficiently estimate these from hidden states in a single forward pass.

Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence
面向具身智能的 Mixture-of-Experts 视频预训练规模化
arXiv:2607.07675 多模态 方法 OA · 绿色 被引 4 · S2

提出 LingBot-Video,一种专为具身智能设计的基于 DiT 的视频预训练范式,并将其作为首个大规模开源 MoE 视频基础模型贡献给社区,致力于在数字创意与物理执行之间搭建桥梁。LingBot-Video is presented, a DiT-based video pretraining paradigm specifically tailored for embodied intelligence, and is contributed as the inaugural large-scale, open-source MoE video foundation model to the community, in a pioneering effort to bridge digital creativity and physical actuation.

Infinite Worlds with Versatile Interactions
支持多样化交互的无限世界
arXiv:2607.07534 多模态 方法 OA · 绿色 被引 9 · S2

首次在 World Modeling 领域引入 Agentic Harness 框架:由 pilot agent 负责规划并执行角色行为,director agent 负责随着场景推进合成新的环境要素。The integration of an agentic harness within the domain of world modeling is pioneered, wherein a pilot agent is tasked with planning and executing character behaviors, while a director agent is responsible for synthesizing novel environmental elements as the scene progresses.

Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation
面向机器人操作的视觉-语言-动作模型中的双潜在记忆
arXiv:2607.07608 多模态 方法 OA · 绿色 被引 1 · S2

提出 LaMem-VLA,一种以潜在记忆为核心框架的方法,将历史经验重建为潜在记忆 token,并直接与 VLA 推理交织,使记忆能够在有界上下文下直接参与 VLA 推理并引导动作生成。LaMem-VLA is introduced, a latent-memory-native framework that reconstructs historical experience into latent memory tokens and directly interweaves them with VLA reasoning, and enables memory to directly participate in VLA reasoning and guide action generation under a bounded context.

DynaKRAG: A Unified Framework for Learnable Evidence Control in Multi-Hop Retrieval-Augmented Generation
DynaKRAG:面向多跳检索增强生成的可学习证据控制统一框架
arXiv:2607.06507 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 DynaKRAG,将多跳证据获取建模为针对原子证据操作的状态条件控制,并展示了在演化证据状态下协同检索、诊断与缺口定向获取的优势。DynaKRAG is introduced, which formulates multi-hop evidence acquisition as state-conditioned control over atomic evidence operations, and demonstrates the benefit of coordinating retrieval, diagnosis, and gap-directed acquisition under an evolving evidence state.

Mitigating Errors in LLM-Generated Web API Invocations via Retrieval-Augmented Generation and Constrained Decoding
通过 RAG 与约束解码缓解 LLM 生成 Web API 调用中的错误
arXiv:2607.05936 RAG 检索增强 方法 被引 0 · S2

结果显示,RAG 在生成完整 API 调用时能够减少幻觉并提升正确性,但在端点已提供的情况下反而会促使生成不必要的参数而降低正确性;约束解码(CD)则能可靠地防止非法 URL、HTTP 方法与参数的出现,并显著提升两种 starter code 的整体正确性。Results show that RAG reduces hallucinations and improves correctness when generating full API invocations but reduces it when the endpoint is already provided as it encourages the generation of unnecessary parameters, and CD reliably prevents illegal URLs, HTTP methods, and arguments and substantially improves overall correctness for both starter codes.

Code-Level Cost Function Generation for Spatial Image Steganography Using RAG-Enhanced Large Language Models
基于 RAG 增强 LLM 的空域图像隐写术代码级代价函数生成
arXiv:2607.05868 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出一种新颖的进化系统,专注于利用 RAG 增强的 LLM 自动生成空域隐写的代码级代价函数;该方法在隐写安全性上一致优于现有自动设计方法,同时提高了平均代码执行率并降低了搜索成本。A novel evolutionary system focused on exploiting Retrieval-Augmented Generation enhanced LLMs for the automatic code-level generation of spatial steganography cost functions, which consistently achieves higher steganographic security than existing automatically designed methods and increases the average code execution rate while reducing the search cost.

WildCity: A Real-World City-Scale Testbed for Rendering, Simulation, and Spatial Intelligence
WildCity:面向渲染、仿真与空间智能的真实城市规模测试平台
arXiv:2607.06838 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

WildCity 是一个由自动驾驶车队在复杂城市环境中采集的真实多模态数据集,旨在推动城市级渲染的进展,并更广泛地推动 AI 在空间感知、记忆与推理方面达到与人类认知相当规模的能力。WildCity, a real-world multimodal dataset collected by autonomous fleets traversing complex urban environments, aims to catalyze progress not only in city-scale rendering, but more broadly in the pursuit of AI that can perceive, remember, and reason across space at a scale comparable to human cognition.

CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
CanvasAgent:通过视觉工具编排实现复杂图像创建与编辑
arXiv:2607.05465 Agent 智能体 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出了用于复杂图像创建与编辑的大规模多模态工具调用数据集 CanvasCraft,以及通过多轮交互学习编排异构视觉工具的工具增强多模态 Agent CanvasAgent。CanvasCraft, a large-scale multimodal tool-use dataset for complex image creation and editing, and CanvasAgent, a tool-augmented multimodal agent that learns to orchestrate heterogeneous visual tools through multi-turn interaction are introduced.

KVpop -- Key-Value Cache Compression with Predictive Online Pruning
KVpop——基于预测性在线剪枝的键值缓存压缩
arXiv:2607.05061 LLM 基础设施 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 KVpop,通过直接监督保留或丢弃决策来学习固定预算的 KV 淘汰策略,并引入基于延迟记忆的打分器,在已学习的淘汰方法中独有地延迟固定步数的打分,以利用近期上下文。KVpop is introduced, which learns a fixed-budget KV eviction policy by directly supervising the keep-or-drop decision, and introduces a delayed memory-based scorer that, uniquely among learned eviction methods, defers scoring for a fixed number of steps to exploit near-future context.

MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing
MV-Forcing:通过 4D 几何基础的时空自强迫实现长多视角视频生成
arXiv:2607.05376 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 MV-Forcing 框架,通过在顺序生成视角之间引入 4D 几何桥梁,在单一扩散模型中组合时间与视角自回归,并弥合时间与视角序列自回归中训练-推理的曝光偏差差距。MV-Forcing, a framework that composes temporal and view-wise autoregression within a single diffusion model by introducing a 4D geometric bridge between sequentially generated views, and closes the train-inference exposure bias gap for both temporal and view-sequential autoregression.

AI Wizards at EXIST 2026: Hierarchical Soft-Label Learning for Multimodal Sexism Identification in Memes
AI Wizards 参加 EXIST 2026:用于迷因中多模态性别歧视识别的分层软标签学习
arXiv:2607.04410 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

该工作通过轻量级 Gated MLP 将固定的 Gemini Embedding 2 视觉-语言表征映射到目标空间,使用 KL 散度与同方差不确定性加权进行训练,并展示了 AI Wizards 参加 EXIST 2026 多模态迷因性别歧视识别任务的提交方案。This work maps fixed Gemini Embedding 2 vision-language representations through a lightweight Gated MLP trained with KL divergence and homoscedastic uncertainty weighting, and presents the AI Wizards submission to EXIST 2026 for multimodal sexism identification in memes.

Improving Access to Historical Archives with Real-time RAG-based Systems
基于实时 RAG 系统提升历史档案的可访问性
arXiv:2607.03440 RAG 检索增强 方法 OA · 绿色 被引 0 · S2 + OpenAlex

该工作提出了一个端到端的档案处理与检索框架,将大语言模型(LLM)集成到档案流程中,并证明将 LLM 与成熟的文档处理与检索流程相结合,可将数字图书馆从静态存储库提升为可交互、可语义检索的档案系统。This work presents an end-to-end archival processing and retrieval framework that integrates large language models (LLMs) into the archival pipeline and demonstrates that integrating LLMs with established document processing and retrieval pipelines can elevate digital libraries from static repositories to interactive, semantically searchable archival systems.

MANCE: Manifold Aware Concept Erasure
MANCE:流形感知的概念擦除
arXiv:2607.03973 LLM 基础设施 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出流形约束假设(Manifold Constraint Hypothesis, MCH):若自然表征集中于一个结构化的低维流形上,则干预应被约束在该流形内,从而在干预过程中更好地保留表征中编码的其他信息。The Manifold Constraint Hypothesis (MCH) is proposed: if natural representations concentrate on a structured, lower-dimensional manifold, then interventions should be constrained to that manifold and better preserve other information encoded in the representation during interventions.

CONFLUX: A Latent Diusion Model for 3D Chest-CT Synthesis with RL Post-Training
CONFLUX:用于胸部 CT 三维合成的潜在扩散模型与强化学习后训练
arXiv:2607.02998 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

CONFLUX 是一个面向胸部 CT 的潜在扩散模型:由 3D 变分自编码器压缩每个体数据,整流流 Transformer 在潜在空间中生成,并以分类器从生成体中恢复所请求病征的可靠性作为奖励。CONFLUX, a latent diffusion model for chest computed tomography (CT): a 3D variational autoencoder compresses each volume, and a rectified-flow transformer generates in the latent space, that rewards how reliably a classifier recovers the requested findings from each generated volume.

Gemma 4 Technical Report
Gemma 4 技术报告
arXiv:2607.02770 多模态 方法 OA · 绿色 被引 42 · S2

本工作推出 Gemma 4——Gemma 模型系列中新一代开源权重、原生多模态的语言模型,在 STEM、多模态与长上下文基准上实现性能跃升,在人类评分任务上可与更大的前沿开源模型相媲美。This work introduces Gemma 4, a new generation of open-weight, natively multimodal language models in the Gemma model family that establishes a leap in performance across STEM, multimodal, and long-context benchmarks, and rivals larger, frontier open models in human-rated tasks.

OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers
OrbitQuant:面向图像与视频扩散 Transformer 的数据无关量化
arXiv:2607.02461 多模态 方法 OA · 绿色 被引 0 · S2 + OpenAlex

本文提出 OrbitQuant,一种数据无关的权重量化器,通过在归一化旋转基空间中进行量化以绕过范围估计,将图像扩散 Transformer 的 PTQ 推进到 W2A4 并保持可用生成质量。OrbitQuant is presented, a data-agnostic weight-activation quantizer that bypasses range estimation by quantizing in a normalized, rotated basis and pushes PTQ of image diffusion transformers to W2A4 with usable generation quality.

When Classic Cache Policies Fail: Learning-Augmented Replacement for Semantic Retrieval Buffers
当经典缓存策略失效时:面向语义检索缓冲区的学习增强替换
arXiv:2607.00394 RAG 检索增强 方法 OA · 绿色 被引 1 · S2

本文提出 SOLAR,一种学习增强框架,从 regret 累积中推导修改时机,并基于隐式检索反馈的贝叶斯在线学习进行内容选择,实现与缓存大小和时域无关的常数竞争比。SOLAR is proposed, a learning-augmented framework that derives modification timing from regret accumulation and content selection from Bayesian online learning over implicit retrieval feedback and achieves a constant competitive ratio, independent of cache size and horizon.

Measuring the Gap Between Human and LLM Research Ideas
衡量人类与 LLM 研究思路之间的差距
arXiv:2607.01233 评测基准 方法 OA · 绿色 被引 3 · S2

结果表明,强大的 LLM 能够产出一系列合理思路,但其范围仍比人类研究品味更窄,并存在系统性偏移。It is suggested that strong LLMs can produce a range of reasonable ideas, but that range remains narrower than, and systematically shifted relative to, human research taste.

Multi-Turn Agentic Scientific Literature Search via Workflow Induction
基于工作流归纳的多轮智能体科学文献搜索
arXiv:2607.00597 Agent 智能体 方法 OA · 绿色 被引 0 · S2 + OpenAlex

结果表明,显式且可编辑的搜索工作流为将文献搜索智能体与复杂科学意图对齐提供了有效且可控的接口。The results show that explicit, editable search workflows provide an effective and controllable interface for aligning literature search agents with complex scientific intent.

Generated Contents Enrichment
生成内容增强
arXiv:2405.03650 多模态 方法 OA · 绿色 被引 1 · S2

本文提出一个联合训练的对抗框架,通过建模对象语义和对象间关系来增强场景图,并在 Visual Genome 数据集上以代理场景图增强指标、图像质量比较、定性示例与用户研究进行评估。A jointly trained adversarial framework is proposed that enriches scene graphs by modeling object semantics and inter-object relations and is evaluated with proxy scene graph enrichment metrics, image-quality comparisons, qualitative examples, and user studies on the Visual Genome dataset.