本文提出 SIS-Bench,一个在统一 self-in-space 表述下评估 UAV 场景具身空间智能的基准,并探索了一种融合光流与视觉特征的运动感知表征,以纳入与自身相关的动态信息。SIS-Bench is introduced, a benchmark for evaluating embodied spatial intelligence in UAV scenarios under a unified self-in-space formulation, and a motion-aware representation that incorporates self-related dynamics through optical flow and visual feature fusion is explored.
论文
1094 张论文卡片
面向第 11 届 ABAW 挑战赛的多任务学习系统,在标准确定性架构基础上扩展条件 Rectified Flow 头,建模真实场景下面部行为固有的模糊性,借助蒙特卡洛采样实现不确定性感知的一对多预测。A multi-task learning system for the 11th ABAW challenge that extends a standard deterministic architecture with a conditional rectified-flow head to model the inherent ambiguity of in-the-wild facial behavior, enabling uncertainty-aware one-to-many predictions through Monte Carlo sampling.
压缩可减少推理 token 并保持大部分选择题准确率,同时提示影响接近基线——在一个前沿条件下,降低推理成本移除的证据比单纯缩短轨迹所预期的更多。Compression reduces reasoning tokens and preserves most multiple choice accuracy, while hint influence remains near baseline, in a frontier where reducing reasoning costs removes more evidence than shorter traces alone would predict.
SPEAR 是一个 Python 库,可通过模块化插件架构连接任意 Unreal Engine 应用并对其进行编程化控制;同时引入一种表达力强的高层编程模型,使用户能够以任意数据依赖关系指定复杂的 UE 工作图,并在单个 UE 帧内确定性执行这些图。SPEAR is a Python library that can connect to, and programmatically control, any Unreal Engine application via a modular plugin architecture, and introduces an expressive high-level programming model that enables users to specify complex graphs of UE work with arbitrary data dependencies among work items, and to execute these graphs deterministically within a single UE frame.
本文提出 VideoChat3,一个完全开放、高效且以视频为中心的通用 MLLM,仅以 4B 参数与更高效率,超越参数量相当或更大的已有开源模型。This work introduces VideoChat3, a fully open, efficient, and generalist video-centric MLLM, which surpasses prior open-source models with equal or larger parameter counts with only 4B parameters and higher efficiency.
研究表明模型具备相关子群体知识,但难以稳定传递到聚合估计中,这一差距使统计自一致性成为评估 LLM 的尚未饱和、无需参考的准则。It is suggested that models possess relevant subpopulation knowledge but do not reliably propagate it into aggregate estimates, and this gap establishes statistical self-consistency as an unsaturated, reference-free criterion for evaluating LLMs.
本文将关键帧执行拆解为存在性、保真度、时序顺序、定位、持续性与唯一性六个互补指标,并通过结合专用感知模型的、基于证据的 MLLM 判断来评估整体视频质量。This work decomposes keyframe execution into six complementary metrics covering presence, fidelity, temporal ordering, localization, persistence, and uniqueness, while assessing overall video quality through evidence-grounded MLLM judgments augmented with specialized perception models.
本文提出 MultiRef-Compass,一个面向 MR2AV 生成的统一基准,将自动指标与引入复判增强的 MLLM-as-a-Judge 框架相结合,实现对感知保真度与参考条件合成能力的可扩展、可审计评估。MultiRef-Compass is introduced, a unified benchmark for MR2AV generation that integrates automatic metrics with a rejudging-enhanced MLLM-as-a-Judge framework, enabling scalable and auditable evaluation of both perceptual fidelity and reference-conditioned composition.
本文从玩家动作控制、游戏状态动态、状态-观测持久性与实时交互生成四个维度审视交互式游戏世界建模,并针对《Black Myth: Wukong》提出可扩展的数据引擎,采集超过 90 小时的游戏画面作为状态感知型游戏世界建模的资源。This paper examines interactive game world modeling along four dimensions: player action control, game state dynamics, state-observation persistence, and real-time interactive generation, and presents a scalable data engine for Black Myth: Wukong that collects over 90 hours of gameplay as a resource for state-aware game world modeling.
本文对 OPD 的作用、病态与调控进行系统研究,厘清 OPD 作为探索催化剂的角色,并证实调控良好的信号质量(而非单纯的教师模型规模)才是 OPD 中成功探索的主导因素。A systematic study examining the role, pathologies, and regulations of OPD, clarifying the role of OPD as an exploration catalyst and confirming that well-regulated signal quality, rather than mere teacher scale, governs successful exploration in OPD.
结果表明稳定的循环深度需要计入参数访问次数(而非仅名义层数)的残差缩放规则;DeepLoop 在不存在物理块被重复访问时表现为中性,一旦启用循环深度则改善验证损失与下游准确率。The results show that stable recurrent depth requires residual scaling rules that account for parameter visits, not only nominal layer count, and DeepLoop is neutral when no physical block is revisited and improves validation loss and downstream accuracy once recurrent depth is activated.
本文提出 UniVR,这是首个从纯视觉演示中同时学习复杂推理、细粒度物理动力学和长期规划的研究,并配套首个在纯视觉协议下评估这些异质能力的综合评测套件。UniVR, the first investigation into simultaneously learning complex reasoning, fine-grained physical dynamics, and long-term planning from pure visual demonstrations, is introduced, the first comprehensive suite to assess these heterogeneous capabilities under a purely visual protocol.
本文提出 LongStraw,一个面向目标、感知架构的系统,用于 resident-state 虚拟化、response replay 和分布式梯度执行,它将实时训练图限制在 response 后缀范围内,同时在完整的 GRPO 组内复用代价高昂的 prompt 计算。This work presents LongStraw, an objective-aware, architecture-aware system for resident-state virtualization, response replay, and distributed-gradient execution that bounds the live training graph by the response suffix while reusing the expensive prompt computation across the complete GRPO group.
提出一个多 Agent 框架,通过结合监督微调、直接偏好优化和检索增强生成 (RAG) 来调和事实基础与意识形态对齐,产生稳定的胜者和排名,且以宣言为锚的谱系能可靠预测现实世界中的实现,而幻觉内容则不能。A multi-agent framework that reconciles factual grounding with ideological alignment by combining Supervised Fine-Tuning, Direct Preference Optimization, and Retrieval-Augmented Generation is presented, which yields a stable winner and ranking, and manifesto-anchored lineage reliably predicts real-world materialization whereas hallucinated content does not.
提出 VIABench,一个专为评估 MLLM 在视障辅助(VIA)场景中表现而设计的综合视频基准,采用视障人士(VIIs)自行录制或分享的第一人称视频,并提出一套严格的评测流水线,同时支持在线(实时)与离线设置。VIABench is introduced, a comprehensive video benchmark specifically designed to evaluate MLLMs in Visually Impaired Assistance scenarios using first-person videos recorded or shared by VIIs themselves, and proposes a rigorous benchmarking pipeline that supports both online (real-time) and offline settings.
提出 GRASP,一个用于训练智能体在多步推理过程中自适应协调互补检索工具的强化学习(RL)框架,并指出学会协调检索信号与上下文粒度对智能体的正确推理至关重要。GRASP is introduced, a reinforcement learning (RL) framework for training agents to adaptively coordinate complementary retrieval tools during multi-step reasoning, and it is suggested that learning to coordinate retrieval signals and context granularity is critical for agent's correct reasoning.
子空间对齐重连(SAR)表明,从参数几何中提取对推理有效的更新,可作为一种无需训练的机制来提升推理与多领域性能。Subspace-Aligned Rewiring (SAR) shows that extracting reasoning-effective updates from parameter geometry can serve as a training-free mechanism to improve reasoning and multi-domain performance.
提出 AI Prototyper,一个开源 Figma 插件,通过分解与 RAG 流水线自动完成 GUI 原型设计,并引入人在回路编辑步骤,允许用户在渲染前审查、修改或扩展生成的功能列表。AI Prototyper is presented, an open-source Figma plugin that automates GUI prototyping through a decomposition and retrieval-augmented generation (RAG) pipeline, and introduces a human-in-the-loop editing step that lets users review, modify, or extend the generated feature list before rendering.
提出 PA-HDP(Prompt-Aware Dynamic Hierarchical Differential Privacy)框架,通过 prompt 感知的风险分层动态评估不同查询下的隐私风险,并采用自适应敏感实体替换与基于指数机制的文本选择,在保留语义可用性的同时提供差异化的隐私保护。A Prompt-Aware Dynamic Hierarchical Differential Privacy framework (PA-HDP) is proposed, which performs a prompt-aware risk hierarchy to dynamically assess privacy risks under different queries and applies adaptive sensitive entity replacement and exponential mechanism-based text selection to provide differentiated privacy protection while preserving semantic utility.
SUFLECA (Scaling Up Feature LEarning for CAD Alignment),一个用于零样本 CAD 对齐的弱监督框架,贡献有二,并提出一种几何一致的匹配算法,可建立可靠的 CAD 到图像的一一对应关系。SUFLECA (Scaling Up Feature LEarning for CAD Alignment), a weakly-supervised framework for zero-shot CAD alignment with two key contributions, and a geometrically consistent matching algorithm that establishes reliable one-to-one CAD-to-image correspondences.
本文提出 HDR (Hierarchical Denoising for Visual Reasoning),一个将层级潜变量集成到因果视频生成中以进行多步推理的统一框架,并引入一个含分布外情况的层级化多步视频推理基准。This work proposes HDR (Hierarchical Denoising for Visual Reasoning), a unified framework that integrates hierarchical latents into causal video generation for multi-step reasoning and introduces a level-stratified multi-step video reasoning benchmark with out-of-distribution cases.
提出 Hy-Embodied-RxBrain,一个具备语言-视觉联合推理与想象的具身认知基础模型,并将其扩展到连续机器人动作生成,在无需大规模动作数据预训练的情况下展现出可观的真实机器人性能。Hy-Embodied-RxBrain, an embodied cognition foundation model with joint language-visual reasoning and imagination, is introduced and extended to continuous robot action generation, where it shows promising real-robot performance without large-scale action-data pretraining.
提出 Chat2Scenic,是首个以领域特定语言 (DSL) 生成场景脚本的迭代式检索增强框架,并构建了一个涵盖 NHTSA、联合国车辆法规及其他来源共 123 个场景的开源场景生成基准。Chat2Scenic is presented, the first iterative retrieval-augmented framework to generate scenario scripts in Domain Specific Language (DSL) and proposes an open benchmark for scenario generation comprising 123 scenarios from various regulations, including NHTSA and United Nations Vehicle Regulations, as well as other sources.
对 LLM Agent 自动 harness 演化进行了广泛评估,在相当的反馈和推理预算下,将 harness 演化与简单的测试时扩展及发现类基线进行比较,并在留出任务上评估演化后的 harness 以判断其发现的改进是否具有泛化性。An extensive evaluation of automatic harness evolution for LLM agents is conducted, comparing harness evolution with simple test-time scaling and discovery baselines under comparable feedback and inference budgets, and also evaluating evolved harnesses on held-out tasks to assess whether the discovered improvements generalize.
认为(该早期版本的)GPT-4 属于新一代具备更通用智能的 LLM(与 ChatGPT、谷歌 PaLM 等并列),并讨论了这些模型不断增强的能力及其影响。It is argued that (this early version of) GPT-4 is part of a new cohort of LLMs (along with ChatGPT and Google's PaLM for example) that exhibit more general intelligence than previous AI models, and the rising capabilities and implications of these models are discussed.
发现对 GPT 语言模型进行重复采样,是为困难 prompt 生成可用解的一种出乎意料的有效策略,并讨论了部署强大代码生成技术在安全性、安全保障与经济等方面的潜在更广泛影响。It is found that repeated sampling from the GPT language model is a surprisingly effective strategy for producing working solutions to difficult prompts, and the potential broader impacts of deploying powerful code generation technologies, covering safety, security, and economics are discussed.
提出 Flamingo,一个 VLM 系列,能够桥接强大的纯视觉与纯语言预训练模型,处理任意交错排列的图文序列,并无缝接收图像或视频作为输入。This work introduces Flamingo, a family of Visual Language Models (VLM) with this ability to bridge powerful pretrained vision-only and language-only models, handle sequences of arbitrarily interleaved visual and textual data, and seamlessly ingest images or videos as inputs.
该综述细致梳理了 RAG 范式的演进,涵盖 Naive RAG、Advanced RAG 与 Modular RAG,并对 RAG 框架的三大基础支柱——检索、生成与增强技术——进行了深入审视。This comprehensive review paper offers a detailed examination of the progression of RAG paradigms, encompassing the Naive RAG, the Advanced RAG, and the Modular RAG, and meticulously scrutinizes the tripartite foundation of RAG frameworks, which includes the retrieval, the generation and the augmentation techniques.
该综述全面回顾了生成模型的历史与基本组件,以及 AIGC 在单模态交互与多模态交互方向的最新进展,并介绍了文本与图像生成任务及相关模型。This survey provides a comprehensive review on the history of generative models, and basic components, recent advances in AIGC from unimmodal interaction and multimodal interaction, and introduces the generation tasks and relative models of text and image.
本文旨在为研究者与从业者提供一份快速、全面的参考,通过对现有工作的广泛、信息密集型总结来汲取洞见,以推动 LLM 研究的发展。This review article is intended to provide a quick, comprehensive reference for the researchers and practitioners to draw insights from extensive, informative summaries of the existing works to advance the LLM research.
提出 BloombergGPT,一个 500 亿参数的语言模型,在广泛的金融数据上训练而成,并基于 Bloomberg 丰富的数据源构建了包含 3630 亿 token 的数据集,可能是迄今最大的领域专用数据集。This work presents BloombergGPT, a 50 billion parameter language model that is trained on a wide range of financial data, and constructs a 363 billion token dataset based on Bloomberg's extensive data sources, perhaps the largest domain-specific dataset yet.
Gemini 1.5 在跨模态长上下文检索任务上取得近乎完美的召回率,在长文档 QA、长视频 QA 与长上下文 ASR 上刷新 SOTA,并在广泛基准上达到或超越 Gemini 1.0 Ultra 的 SOTA 表现。Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks.
Reflexion 是一个通过语言反馈而非更新权重来强化语言 agent 的新框架,在多种任务(序贯决策、编程、语言推理)上相较基线 agent 取得显著提升。Reflexion is a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback, which obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning).
HuggingGPT 是一个由 LLM 驱动的 Agent,利用 LLM(如 ChatGPT)连接机器学习社区中的各种 AI 模型以解决 AI 任务,能够处理跨模态、跨领域的大量复杂 AI 任务。HuggingGPT is an LLM-powered agent that leverages LLMs (e.g., ChatGPT) to connect various AI models in machine learning communities to solve AI tasks and can tackle a wide range of sophisticated AI tasks spanning different modalities and domains.
详细介绍大多数 GAN 算法的动机、数学表示与结构,并对它们的共性与差异进行比较。The motivations, mathematical representations, and structures of most GAN algorithms are introduced in detail, and they are compared to compare their commonalities and differences.
一篇关于基于 LLM 的 Agent 的全面综述,追溯了 Agent 概念从其哲学起源到在 AI 中的发展历程,解释了为何 LLM 适合作为 Agent 的基础,并提出一个包含三个核心组件的通用框架:大脑、感知与行动。A comprehensive survey on LLM-based agents, tracing the concept of agents from its philosophical origins to its development in AI, and explaining why LLMs are suitable foundations for agents, and presenting a general framework, comprising three main components: brain, perception, and action.