研究发现,recall@k 并非已部署 KB-VQA 的正确评价指标,且弥合差距需要 reader 侧介入;本文首次对多模态 KB-VQA 中 reader 侧位置依赖性进行了受控探查,设计了一种 gold-position 协议——在问题提示中仅改变 gold passage 所在的槽位。The findings indicate that recall@k is the wrong metric for deployed KB-VQA and that closing the gap requires reader-side intervention; the first controlled probe of reader-side position dependence in multimodal KB-VQA is designed, a gold-position protocol in which only the gold passage's prompt slot varies within question.
论文
39 张论文卡片 · 观点
AsymCache 是一个面向 LLM 推理的计算-延迟感知 KV cache 管理系统,将 cache 驻留决策与 GPU attention kernel 性能显式对齐,包含三个关键组件:用于高效处理非连续 KV 上下文的多段注意力(MSA)、联合优化命中率与位置感知重计算代价的 cache 淘汰策略,以及面向高硬件利用率的自适应分片调度器。AsymCache is proposed, a computation-latency-aware KV cache management system for LLM inference that explicitly aligns cache residency decisions with GPU attention kernel performance, including three key components: Multi-Segment Attention (MSA) for efficient non-contiguous KV context processing, a cache eviction policy that jointly optimizes hit rate and position-aware recomputation cost, and an adaptive chunking scheduler for high hardware utilization.
这篇立场论文认为,LLM 推理 serving 已超越通用启发式方法,如今需要数学优化与算法基础,并呼吁社区将 LLM serving 的算法设计视为一个新的研究前沿。This position paper argues that LLM inference serving has outgrown generic heuristics and now demands mathematical optimization and algorithmic foundations, and calls on the community to recognize algorithmic design for LLM serving as a research frontier.
揭示使用工具的 LLM Agent 的一种部署失效模式——来源缺口,以及一类跨上下文多步越狱攻击,可在早期交互中保留看似无害的中间产物,并在很久以后(可能在不同 Agent 实例或工作流阶段)诱发有害行为。A deployment failure mode for tool-using LLM agents, the provenance gap, and a family of cross-context multi-step jailbreaks that preserve benign-looking intermediate artifacts from an early interaction and elicit harmful behavior much later, potentially in a different agent instance or workflow stage.
通过形式化分析与架构分解,展示 SSGM 如何缓解拓扑引发的知识泄漏(敏感上下文被固化到长期存储),以及有助于防止语义漂移(知识在迭代摘要中退化)。Through formal analysis and architectural decomposition, it is shown how SSGM can mitigate topology-induced knowledge leakage where sensitive contexts are solidified into long-term storage, and help prevent semantic drift where knowledge degrades through iterative summarization.
文章认为基于实体的分解能形成对原始信息更精炼的表示,并有助于降低索引与生成过程中的噪声;在端到端 QA 评测中,VectorRAG 表现优于标准 GraphRAG,且接近当前 SOTA 图方法的效果。It is argued that entity-based decomposition yields a more distilled representation of original information, and additionally serves to reduce noise in the indexing, and generation process, and on end to end QA evaluation VectorRAG performs better than standard GraphRAG and almost as good as current SOTA graph-based solutions.
研究表明,机器学习在公共部门的成功,将更少依赖模型准确率的突破,而更多依赖机构能否构建出透明、可复现、可问责且受公民信任的数据基础设施。It is shown that the success of machine learning in the public sector will depend less on breakthroughs in model accuracy and more on the ability of institutions to engineer transparent, reproducible, and accountable data infrastructures that citizens can trust.
提出一种审计方法,度量每个检索文档的留一因果影响,并对影响集中于低可信度文档的答案进行标记;并提出一种审计方法,度量每个检索文档的留一因果影响,并对影响集中于低可信度文档的答案进行标记。An audit is proposed that measures the leave-one-out causal influence of each retrieved document and flags answers whose influence concentrates on low-trust documents, and proposes an audit that measures the leave-one-out causal influence of each retrieved document and flags answers whose influence concentrates on low-trust documents.
本文提出 MathForm,一个通过 Mathlib 知识检索与验证引导的迭代优化来构建已验证训练数据的自动形式化框架,性能优于多个专用的 32B 自动形式化模型。MathForm is introduced, an autoformalization framework for constructing verified training data through Mathlib knowledge retrieval and verification-guided iterative refinement, and outperforming multiple specialized 32B autoformalizers.
本文提出一种分层隔离架构,结合策略感知的 ingestion、retrieval-time gating 与共享推理,并通过服务端 agentic 编排加以执行,在为多租户隔离提供天然强制点的同时,允许客户端框架保留对 agent 组合与延迟敏感操作的控制权。A layered isolation architecture combining policy-aware ingestion, retrieval-time gating, and shared inference, enforced through server-side agentic orchestration is introduced, creating natural enforcement points for multitenant isolation while allowing client-side frameworks to retain control over agent composition and latency-sensitive operations.
本文探讨 Paxos 与 Raft 何者更优地解决分布式共识问题,通过以 Raft 的术语与实用抽象描述一个简化的 Paxos 算法,精确揭示两者的差异。This paper considers the question of which algorithm, Paxos or Raft, is the better solution to distributed consensus to determine exactly how they differ by describing a simplified Paxos algorithm using Raft's terminology and pragmatic abstractions.
本文将 Agentic 检索-生成循环形式化为有限时域部分可观测马尔可夫决策过程,显式建模其控制策略与状态转移,并构建了全面的分类体系与模块化架构分解,按规划机制、检索编排、记忆范式与工具调用行为对系统进行分类。This paper formalizes agentic retrieval-generation loops as finite-horizon partially observable Markov decision processes, explicitly modeling their control policies and state transitions, and develops a comprehensive taxonomy and modular architectural decomposition that categorizes systems by their planning mechanisms, retrieval orchestration, memory paradigms, and tool-invocation behaviors.
WARP:一个直接从已发布权重还原微调模型训练数据混合比例的框架,抽取几何特征并映射至各领域占比,可采用无参数 softmax 读出器,或基于合成混合训练的 MLP 投影器。WARP is introduced, a framework that recovers a fine-tuned model's training mixtures directly from its released weights and extracts geometric features and maps them to domain proportions using either a parameter-free softmax readout or an MLP projector trained on synthetic mixtures.
本文提出 Randomized YaRN,一种通过将基于 YaRN 的位置外推与随机位置编码和长度课程相结合来提升长度泛化能力的训练方法,表明渐进式地将模型暴露于分布外位置分布是实现可泛化长上下文推理的有效方案。Randomized YaRN is proposed, a training method that improves length generalization by combining YaRN-based positional extrapolation with randomized positional encoding and a length curriculum, and suggests that progressively exposing models to OOD positional distributions provides an effective recipe for generalizable long-context reasoning.
本文通过收益–成本视角研究 PLT 循环次数选择:额外循环可精炼表示,但 CLP 也会在每次循环边界引入位置错配,由此解释 PLT 在两次循环时趋于饱和的现象,并为循环次数选择提供诊断依据。This study studies PLT loop-count selection through a gain--cost view: an extra loop may refine representations, but CLP also introduces a positional mismatch at each loop boundary, explaining PLT's saturation at two loops and providing diagnostics for loop-count selection.
在 MS MARCO 与真实生产流量上的结果表明,自适应检索 cardinality 能够在不降低检索质量的前提下提升检索效率。Results on both MS MARCO and real-world production traffic suggest that adaptive retrieval cardinality can improve retrieval efficiency without degrading retrieval quality.
本文在视觉语言导航、具身问答和语言条件操控任务上评估了三种 AAS 变体,覆盖四个具身执行器,结果表明架构级搜索能在具身任务上产生可部署且具有方向性的成功率提升,而其中一个看似得分较高的候选因存在泄漏而被判定为无效。This work evaluates three AAS variants across four embodied executors spanning vision-language navigation, embodied question answering, and language-conditioned manipulation, and shows that architecture-level search can produce deployable and directional success-rate gains on embodied tasks, while one apparent high-scoring candidate is rejected as leak-bearing.
本文论证了稀疏组合监督与动宾学习的不对称性会助长物体驱动的捷径学习,并指出减少捷径诊断可提升组合泛化能力。This work argues that sparse compositional supervision and verb-object learning asymmetry can promote object-driven shortcut learning and reduces shortcut diagnostics and consequently improves compositional generalization.
通过考察包含意识形态话语的 RAG 框架对 LLM 生成答案的影响,发现 RAG 框架倾向于将意识形态话语传递到 LLM 响应中,且采样温度对这种传递的强度有可测量的影响。Examining the influence of the RAG framework, comprising ideological discourses, in LLM-generated answers shows that the RAG framework is prone to transferring ideological discourses into LLM responses, with sampling temperature having a measurable impact on the strength of this transfer.
本文从玩家动作控制、游戏状态动态、状态-观测持久性与实时交互生成四个维度审视交互式游戏世界建模,并针对《Black Myth: Wukong》提出可扩展的数据引擎,采集超过 90 小时的游戏画面作为状态感知型游戏世界建模的资源。This paper examines interactive game world modeling along four dimensions: player action control, game state dynamics, state-observation persistence, and real-time interactive generation, and presents a scalable data engine for Black Myth: Wukong that collects over 90 hours of gameplay as a resource for state-aware game world modeling.
提出 AI Prototyper,一个开源 Figma 插件,通过分解与 RAG 流水线自动完成 GUI 原型设计,并引入人在回路编辑步骤,允许用户在渲染前审查、修改或扩展生成的功能列表。AI Prototyper is presented, an open-source Figma plugin that automates GUI prototyping through a decomposition and retrieval-augmented generation (RAG) pipeline, and introduces a human-in-the-loop editing step that lets users review, modify, or extend the generated feature list before rendering.
提出 PA-HDP(Prompt-Aware Dynamic Hierarchical Differential Privacy)框架,通过 prompt 感知的风险分层动态评估不同查询下的隐私风险,并采用自适应敏感实体替换与基于指数机制的文本选择,在保留语义可用性的同时提供差异化的隐私保护。A Prompt-Aware Dynamic Hierarchical Differential Privacy framework (PA-HDP) is proposed, which performs a prompt-aware risk hierarchy to dynamically assess privacy risks under different queries and applies adaptive sensitive entity replacement and exponential mechanism-based text selection to provide differentiated privacy protection while preserving semantic utility.
该报告主张并例证了一种严谨且基于经验的方法来研究 AI 意识:依据获得最佳支持的神经科学意识理论,详细评估现有 AI 系统。This report argues for, and exemplifies, a rigorous and empirically grounded approach to AI consciousness: assessing existing AI systems in detail, in light of best-supported neuroscientific theories of consciousness.
提出了ShotPlan,一个基于视频扩散基础模型构建的、用于显式多镜头电影级视频生成的框架,显著优于现有的电影级视频生成方法,提供更灵活的镜头管理和更强的跨镜头一致性。ShotPlan is proposed, a framework for explicit multi-shot cinematic video generation built upon a video diffusion foundation model that significantly outperforms existing cinematic video generation methods, offering more flexible shot management and stronger inter-shot consistency.
本文认为,可解释 AI 研究总体上有助于推动 AI/ML 在医疗领域的落地,并特别有助于增强透明性与信任。It is argued that research in explainable-AI would generally help to facilitate the implementation of AI/ML in the medical domain, and specifically help to facilitates transparency and trust.
提出结构化动态模型(SDM),通过未来特征预测,显式地将时间变化的主导来源与残差动态分离开来,而非使用单一纠缠的隐变量或非结构化的、空间密集的转移 token 来表示视频变化。The Structured Dynamics Model (SDM) is proposed, which explicitly separates the dominant source of temporal change from residual dynamics through future-feature prediction, rather than representing video change with a single entangled latent or with unstructured, spatially dense transition tokens.
将 Positive--Direction Matching (PDM)——一种分支感知的 OPD 目标,分别约束正预测方向与 CFG 条件方向——引入 dense-to-sparse 视频控制;由于朴素的 guided matching 对推理 guidance 尺度极为敏感,分支感知监督可实现更鲁棒、更有效的知识迁移。Positive--Direction Matching (PDM), a branch-aware OPD objective that separately constrains the positive prediction and the CFG conditional direction, is introduced to dense-to-sparse video control, where naive guided matching is highly sensitive to inference guidance scales, while branch-aware supervision enables more robust and effective knowledge transfer.
本文提出 ReDesign,一种 agentic 框架,通过跨模态选择与组合专用工具来构建可编辑的层级结构(layer hierarchy),在取得强视觉保真度的同时,于布局、颜色与文本编辑上提供最高的可编辑性。ReDesign is presented, an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities, and achieves strong visual fidelity while delivering the highest editability across layout, color, and text edits.
提出一种自适应推理时引导框架,利用VLA Latents上的强化学习,发现推理时引导在成功与失败状态下遵循根本不同的scaling laws:动作多样性在基础VLA可能失败时最为有益,但在成功可能性高时可能不必要地扰动已准确的动作。This work introduces an adaptive inference-time steering framework that leverages Reinforcement Learning on VLA Latents, and discovers that inference-time steering follows fundamentally different scaling laws under success and failure states, revealing that action diversity is most beneficial when the base VLA is likely to fail, but can unnecessarily perturb already-accurate actions when success is likely.
情感对话研究包含两种颇具影响力的策略传统。共情对话优先理解说话者的情绪体验;情感支持对话则选择并排序以满足求助者当前的需求。持续使用引入了更进一步的目标:有效的支持应在整个交互生命周期中维持用户进行情绪调节、应对、自我认同决策以及社会联结的能力。我们提出能力维持型情感对话(CSED)作为一种纵向研究范式,将支持策略与上述目标对齐,并...Emotional dialogue research includes two influential strategy traditions. Empathetic dialogue prioritizes understanding a speaker's emotional experience. Emotional support conversation selects and sequences support for the seeker's current needs. Sustained use introduces a further goal. Effective support should sustain users' capacities for emotion regulation, coping, self-endorsed decisions, and social connection across the interaction lifecycle. We propose capability-sustaining emotional dialogue (CSED) as a longitudinal research paradigm that aligns supportive strategy with this goal and or
发现 ALiBi 的失效模式会显著损害 token 检索,而对标准 decoder 基准影响较小;提出四种训练时缓解策略,在 passkey 检索上获得最一致的提升。It is found that ALiBi's failure mode can substantially impair token retrieval while having only a minor effect on standard decoder benchmarks, and proposes four training-time mitigation strategies that yield the most consistent improvements in passkey retrieval.
EffectLearner 是一个语义推理增强框架,结合基于 VLM 的 Object-Effect Reasoner 与基于 DiT 的 Video Eraser,在 EffectWorld-Eval 和具有挑战性的 EffectWorld-Wild 上均取得明显优势,证明其能在复杂真实场景中实现高质量的视频物体擦除。EffectLearner is proposed, a semantic-reasoning-enhanced framework that combines a VLM-based Object-Effect Reasoner with a DiT-based Video Eraser that achieves clear advantages on both EffectWorld-Eval and the challenging EffectWorld-Wild, demonstrating its ability to deliver high-quality video object removal in complex real-world scenes.
在客观与主观指标上的重建和生成结果匹配或超越前沿开源 tokenizer,包括 Wan-2.2、HunyuanVideo-1.5、FLUX.2、MovieGen、StableAudio 和 MMAudio 的 VAE。It is demonstrated that reconstruction and generation results on objective and subjective metrics matches or surpasses frontier opensource tokenizers, such as VAEs from Wan-2.2, HunyuanVideo-1.5, FLUX.2, MovieGen, StableAudio and MMAudio.
HiSparse 已合入上游 SGLang,并在 H200、B200 与 GH200 平台上针对 DSA、NSA、Quest 三类稀疏注意力家族进行评估:在长上下文负载下峰值生成吞吐提升最高达 4.7×,同时保持可比的 per-token 延迟,并降低高负载下的 time-to-first-token。HiSparse is merged into upstream SGLang and evaluated across three sparse-attention families (DSA, NSA, and Quest) on H200, B200, and GH200 platforms: it improves peak generation throughput by up to 4.7x on long-context workloads while preserving comparable per-token latency and reducing time-to-first-token at high load.
与现有句法语言模型在推理时对众多句法树求边际或在运行时丢弃句法不同,SiPE 以单一句法树为条件,在句法监督与推理成本之间建立了新的 Pareto 前沿。Unlike existing syntactic language models that marginalize over many parses at inference or discard syntax at runtime, SiPE conditions on a single parse, establishing a new Pareto frontier between syntactic supervision and inference cost.
这篇立场论文定义了可解释性,阐述了何时需要(以及何时不需要)可解释性,并提出了一种用于严格评估的分类法,同时指出了迈向更严谨的可解释机器学习科学所面临的开放性问题This position paper defines interpretability and describes when interpretability is needed (and when it is not), and suggests a taxonomy for rigorous evaluation and exposes open questions towards a more rigorous science of interpretable machine learning.