本文提出新的计算机视觉基础模型 Florence,通过融入来自 Web 规模图文数据的通用视觉-语言表示,将表征范围从粗粒度(场景)扩展到细粒度、从静态(图像)扩展到动态(视频)、从 RGB 扩展到多种模态(描述、深度等)。This work introduces a new computer vision foundation model, Florence, to expand the representations from coarse (scene) to fine, from static (images) to dynamic (videos), and from RGB to multiple modalities (caption, depth), by incorporating universal visual-language representations from Web-scale image-text data.
论文
1686 张论文卡片 · OA 绿色
于 2018 年 8 月 28 日中午 12:15 在 Pettit 微电子研究中心 102 A/B 室进行报告。Presented on August 28, 2018 at 12:15 p.m. in the Pettit Microelectronics Research Center, Room 102 A/B.
本文提出了不变风险最小化(IRM),一种用于在多个训练分布上估计不变相关性的学习范式,并展示了 IRM 学到的不变性如何与数据的因果结构相关,从而实现分布外泛化。This work introduces Invariant Risk Minimization, a learning paradigm to estimate invariant correlations across multiple training distributions and shows how the invariances learned by IRM relate to the causal structures governing the data and enable out-of-distribution generalization.
本文在每个时间步以骨骼作为输入,引入一种新的正则化方案来学习骨骼关节的共现特征,并提出一种同时作用于 LSTM 神经元门、单元和输出响应的新型 dropout 算法。This work takes the skeleton as the input at each time slot and introduces a novel regularization scheme to learn the co-occurrence features of skeleton joints, and proposes a new dropout algorithm which simultaneously operates on the gates, cells, and output responses of the LSTM neurons.
研究表明 BigBird 是序列函数的通用逼近器,且具备图灵完备性,从而保留了二次全注意力模型的这些性质。It is shown that BigBird is a universal approximator of sequence functions and is Turing complete, thereby preserving these properties of the quadratic, full attention model.
提出 FaceVid-Forensics-100K,一个大规模深伪视频数据集,包含 100,000 个视频,涵盖 33 种合成方法,覆盖换脸、表情重演与全脸合成;同时提出一个多智能体取证推理框架,由四个领域专家 Agent 分别从四个角度独立分析伪造线索。FaceVid-Forensics-100K is introduced, a large-scale deepfake video dataset comprising 100,000 videos and spanning 33 synthesis methods across face swapping, face reenactment, and entire-face synthesis, and a multi-agent forensic reasoning framework that employs four specialized domain-expert agents to independently analyze forgery cues from four perspectives.
提出 Decoupling CLI Agent Scaffolding(DCAS),一种后端替换的拦截层,可在不修改 scaffold 的前提下,在任意 CLI scaffold 与任意后端模型之间路由 API 流量,从而支持跨 scaffold 评估与具备规划感知的轨迹采集。Decoupling CLI Agent Scaffolding (DCAS) is introduced, a backend-substitution interception layer that routes API traffic between any CLI scaffold and any backend model without modifying the scaffold, enabling cross-scaffold evaluation and planning-aware trajectory collection.
本文提出 Enfold,将构建未来的计算转移到由当前视觉上下文和语言指令预测出的表征中,并把世界生成器重塑为预测控制表征的来源,前提是其内部结构可被折叠(enfold)到当下。This work presents Enfold, which transfers this computation that constructs a future into a representation predicted from the current visual context and language instruction, and recast a world generator as a source of predictive control representations if its internal structure can be enfolded into the present.
训练一个紧凑分类器,对被省略的句子按其是否为理解保留文本所必需进行排序,并在推理时无需支撑标注地回插排名靠前的候选,同时优化相关性与指代完整性。A compact classifier is trained to rank omitted sentences by whether they are needed to interpret retained text and reinsert the top-ranked candidates without support annotations at inference, training a compact classifier to optimize both relevance and referential completeness.
CLIP-CC-Bench 为长视频描述提供了一个实用的评估框架,填补了现有短片段和仅 QA 基准的空白,并通过评分者间一致性(inter-judge agreement)与 bootstrap 排序稳定性量化该协议的内可靠性。CLIP-CC-Bench provides a practical evaluation framework for long-form video description, filling a gap left by existing short-clip and QA-only benchmarks and quantifying the protocol's internal reliability through inter-judge agreement and bootstrap ranking stability.
本文提出 MatrAIx,一个面向异构用户的群体规模模拟用户评估基础设施,为使用多样化模拟人类用户评估 AI 系统和数字产品提供端到端支撑。MatrAIx is introduced, a population-scale simulated-user evaluation infrastructure for testing AI systems and digital products with heterogeneous users and provides an end-to-end infrastructure for evaluating AI systems and digital products with diverse simulated human users.
本文提出 Self-Modulating QKAN-based FWPs,用低秩生成的逐元素调制(作用于新提案分支、有界旧状态分支或两者)替代该广播门,并提出 Complementary Matrix Gating (CMG),在保持标量门控的有界凸更新和仿射前缀扫描结构的同时提供逐坐标的记忆控制。This work introduces Self-Modulating QKAN-based FWPs, which replace this broadcast gate with low-rank-generated element-wise modulation of the new-proposal branch, a bounded old-state branch, or both, and proposes Complementary Matrix Gating (CMG), which provides coordinate-wise memory control while preserving the bounded convex update and affine prefix-scan structure of scalar gating.
本文提出 DuplexGen,一个通过少量 slot 级人类偏好标注对 LLM 预测进行校准从而生成具有场景自适应轮换特性的对话框架;结果表明,使轮换合成具备场景特异性的关键是人类校准,而非单纯的语料规模或提示设计。DuplexGen is introduced, a framework for generating dialogues with scenario-adaptive turn-taking by calibrating LLM predictions against a small set of slot-level human preference annotations, and results show that human calibration, not corpus scale or prompt design alone, is what allows turn-taking synthesis to be scenario-specific.
Evo-Bench 是首个跨 Search、Office 和 General Agent 领域评估模型内在 harness 演化能力的基准,并暴露了早期饱和等关键时序异常,同时证明所合成的 harness 是高度可迁移的推理结构,能持续提升多样化策略模型。Evo-Bench is the first benchmark designed to evaluate models'intrinsic harness-evolving capabilities across Search, Office, and General agent domains, and exposes critical temporal anomalies like early saturation, while demonstrating that the synthesized harnesses act as highly transferable reasoning structures, consistently boosting diverse policy models.
RynnValue 是一个用于机器人操控的开源价值基础模型,用时间距离(即从观测到语言指定目标的有向 cost-to-go)替代任务内部锚点,将时间距离确立为通用机器人策略的可扩展监督目标和实用奖励接口。RynnValue, an open-source value foundation model for robotic manipulation that replaces task-internal anchors with temporal distance, the directed cost-to-go from an observation to the language-specified goal, establishes temporal distance as a scalable supervision target and practical reward interface for generalist robot policies.
我们提出 Ouroboros,一个自进化的 Agent harness,其工具、提示、上下文组装与核心实现通过已评审的 commit 持续改进,并成为后续工作的运行时。核心演化以两种模式推进:在递归自由演化中,改进本身就是任务,完成一个演化周期即可调度下一周期;在经验驱动核心演化中,常规工作和社交交互暴露的 bug、粗糙之处及低效上下文构造会引发已评审的结构变更。在 Terminal-Bench 2.1 上,Opus 5 运行取得 86.74% 的得分,为该基准报告的最佳结果。We present Ouroboros, a self-developing agent harness whose tools, prompts, context assembly, and core implementation improve through reviewed commits that become the runtime for later work. Core evolution proceeds in two modes. In recursive free evolution, improvement is itself a task, and completing one evolution cycle can schedule the next. In experience-driven core evolution, ordinary work and social interaction expose bugs, rough edges, and inefficient context construction that lead to reviewed structural changes. On Terminal-Bench 2.1, an Opus 5 run scores 86.74%, the best result reporte
本文提出 OasisKV,一种以显存为中心的 LLM 推理系统设计,通过在 LLM 解码期间将完整 KV-cache 存储与 HBM 解耦来缓解 HBM 容量压力,并观察到未来重要 token 可借助推测解码(SD)所起草的前瞻 token 被提前准确预测。OasisKV is presented, a memory-centric LLM inference system design that alleviates HBM capacity pressure by decoupling full KV-cache storage from HBM during LLM decoding and observes that future important tokens can be predicted accurately in advance using lookahead tokens drafted by speculative decoding (SD).
本文提出 Agent Memory Distillation (AMD),一个无需训练、通过分层记忆将结构化知识从大型教师智能体迁移到小型学生智能体的框架,一致优于现有基于记忆的基线方法。Agent Memory Distillation (AMD), a training-free framework that transfers structured knowledge from a large teacher agent to a small student agent through hierarchical memory, is proposed, which consistently outperforms existing memory-based baselines.
Steerling-8B 在与训练计算量多 2–16 倍的开源同侪模型对比中仍保持竞争力,表明存在一种不同的可扩展范式:可解释性可以被设计进训练过程中,并随规模放大而提升。Steerling-8B remains competitive with open peer models trained on substantially 2-16x more compute, suggesting a different scaling paradigm: interpretability can be designed into training, and it improves with scale.
本文提出 Factorized Hypothesis Search (FHS),在多个命名语义维度上维护多个部分解释,以支持结构化查询渲染、多假设检索以及维度级候选验证。This work proposes Factorized Hypothesis Search (FHS), which maintains multiple partial interpretations over named semantic dimensions that support structured query rendering, multi-hypothesis retrieval, and dimension-level candidate verification.
一个三阶段框架,用于减少建议编辑与当前图像之间的视觉不一致性,并将推荐 CTR、图像带走率以及用户平均对话轮次分别显著提升 39.90%(所有 p<0.05)。A three-stage framework to reduce visual inconsistencies between suggested edits and the current image, which significantly improves recommendation CTR, image take-away rate, and average conversation turns per user by 39.90% (all p<0.05).
本文提出 BDH-CQ,一个结合上下文学习与循环潜在推理的推理模型,通过在高维潜在空间中的迭代计算来求解查询,且无需将中间推理外化为语言。BDH-CQ is introduced, a reasoning model that combines in-context learning with recurrent latent reasoning that solves a query through iterative computation in a high-dimensional latent space, without verbalizing its intermediate reasoning.
本文识别出一种绕过 anti-distillation 机制、允许攻击者窃取专有模型推理能力的架构漏洞,并提出具体的密码学与系统级缓解措施以保障客户端推理安全。An architectural vulnerability is identified that circumvents anti-distillation mechanisms, allowing adversaries to extract a proprietary model's reasoning, as well as proposing concrete cryptographic and system-level mitigations to secure client-side reasoning.
所提架构通过提供模块化、面向实现的具身认知能力 IVA 部署框架,弥合高层智能体推理模型与实时具身执行之间的鸿沟,助力在复杂交互虚拟环境中构建可扩展、自适应且可解释的智能体。The proposed architecture contributes by providing a modular, implementation-oriented framework for the deployment of embodied, cognitive-capable IVAs and bridges the gap between high-level agent reasoning models with real-time embodied execution, for scalable, adaptive, and explainable agents in complex interactive virtual environments.
本文提出 Ego-OSCAR,一种用于野外自我中心数据采集的开源硬件、低成本、头戴式立体惯性采集设备,旨在成为众包自我中心采集中最廉价且可辩护的载体,降低任何团队大规模采集自我中心数据的启动门槛。Ego-OSCAR is presented, an open-hardware, low-cost, head-mounted stereo-inertial capture device for egocentric data collection in the wild that aims to be the cheapest defensible substrate for crowdsourced egocentric capture, and to lower the activation energy for any team that wants to collect egocentric data at scale.
该形式化方法将短语定位、指代表达定位以及开放词汇检测等常见 grounding 任务统一起来,将文本分割、图像分割以及跨模态对齐视为单一的对应预测问题。This formulation unifies common grounding tasks, including phrase grounding, referring expression grounding, and open-vocabulary detection, by treating text segmentation, image segmentation, and cross-modal alignment as a single correspondence prediction problem.
一个结构定理将无记忆等变规则刻画为恰好由 Gram 矩阵决定的左预处理子;一个迁移定理将梯度流的路径性质推广到 common-scalar 流。A structure theorem characterizes the memoryless equivariant rules as exactly the Gram-determined left preconditioners, and a transfer theorem carries gradient flow's pathwise properties to common-scalar flows.
本文提出 WeClawArena,一个面向个人工作空间多参与方 owned-agent 协作的可审计基准与运行时沙盒,基于有界运行时证据审计攻击成功情况,支持任务分解失败、隐私泄露、证据投毒以及权限路径失效等问题的诊断。WeClawArena is introduced, an auditable benchmark and runtime sandbox for multi-party owned-agent collaboration over personal workspaces and audits attack success from bounded runtime evidence, supporting diagnosis of task breakdown, privacy leakage, poisoned evidence, and invalid authority paths.
本文提出 MMOOC,一个用于评估 MLLMs 拒答与鲁棒回答能力的大规模 benchmark,并引入 LLM-as-a-Judge 指标来衡量模型推理的正确性。This work presents MMOOC, a large-scale benchmark for evaluating refusal and robust answering abilities of MLLMs, and introduces an LLM-as-a-Judge metric to assess the correctness of model reasoning.
本文讨论了一种被称为大语言模型涌现能力的不可预测现象——若某项能力在小模型中不存在而在大模型中存在,则称为涌现。This paper discusses an unpredictable phenomenon that is referred to as emergent abilities of large language models, an ability to be emergent if it is not present in smaller models but is present in larger models.
本工作研究图结构输入的特征学习技术,并在程序验证任务上取得 SOTA 性能,该任务需将子图与抽象数据结构进行匹配。This work studies feature learning techniques for graph-structured inputs and achieves state-of-the-art performance on a problem from program verification, in which subgraphs need to be matched to abstract data structures.
本文针对 OOD 检测领域的近期技术发展空白,提出统一框架 generalized OOD detection(广义 OOD 检测),涵盖上述五类问题,即 AD、ND、OSR、OOD detection 与 OD。This paper addresses the gap in recent technical developments in recent technical developments in the field of OOD detection by presenting a unified framework called generalized OOD detection, which encompasses the five aforementioned problems, i.e.,AD, ND, OSR, OOD detection, and OD.
综述领域自适应与迁移学习,重点关注视觉应用及超越图像分类的方法,如目标检测、图像分割、视频分析或视觉属性学习。An overview of domain adaptation and transfer learning with a specific view on visual applications and the methods that go beyond image categorization, such as object detection or image segmentation, video analyses or learning visual attributes are overviewed.
提出 MultiMedQA 基准,整合六个现有医学问答数据集(涵盖专业医学、研究与消费者查询)及一个全新的在线医学问题搜索数据集,并提出针对模型答案的人工评估框架,揭示了 LLM 在医学领域的潜在应用价值。MultiMedQA, a benchmark combining six existing medical question answering datasets spanning professional medicine, research and consumer queries and a new dataset of medical questions searched online, is presented and a human evaluation framework for model answers is proposed, suggesting the potential utility of LLMs in medicine.
本文给出 ICL 的形式化定义,厘清其与相关研究的联系,并梳理讨论训练策略、提示设计策略及相关分析等高级技术。This paper presents a formal definition of ICL and clarify its correlation to related studies, and organizes and discusses advanced techniques, including training strategies, prompt designing strategies, and related analysis.
本文提出 KGCaRe,一种将神经检索与基于 LLM 生成 KG 的符号推理相结合的混合方法,在 Vanilla LLM、Code Prompt、Text Prompt、Think-on-Graph、Vanilla RAG 和 HybridContextQA 等 baseline 上 consistently 取得更优表现。KGCaRe is proposed, a hybrid approach that combines neural retrieval with symbolic reasoning over LLM-generated KGs that consistently outperforms existing baselines, including Vanilla LLM, Code Prompt, Text Prompt, Think-on-Graph, Vanilla RAG, and HybridContextQA.