实验表明,与语言模型类似,视觉模型也会学习利用全局捷径,从而无法在任务长度或复杂度上泛化,但本文证明基于严格局部感知的循环视觉策略可以缓解这些失败,从而使模型在这些任务上具备泛化能力。The experiments reveal that, similar to language models, vision models can learn to exploit global shortcuts and thereby fail to generalize over task length or complexity, but it is shown that recurrent vision policies based on strictly local perception can mitigate these failures, thereby allowing models to generalize on these tasks.
论文
1094 张论文卡片
本文试图以简洁的方式描述受生成式 AI 影响的主要行业与模型,并给出近期主要生成式模型的分类体系。This work consists on an attempt to describe in a concise way the main models are sectors that are affected by generative AI and to provide a taxonomy of the main generative models published recently.
综合评估表明,DeepSeek-V3 优于其他开源模型,并达到与领先闭源模型相当的性能。Comprehensive evaluations reveal that DeepSeek-V3 outperforms other open-source models and achieves performance comparable to leading closed-source models.
本文给出了 LLM 幻觉现象与评估基准的分类体系,分析了现有缓解 LLM 幻觉的方法,并讨论了未来研究的潜在方向。This paper presents taxonomies of the LLM hallucination phenomena and evaluation benchmarks, analyzes existing approaches aiming at mitigating LLm hallucination, and discusses potential directions for future research.
本文在交通微观仿真器 SUMO 中应用现代深度强化学习方法构建一个真正自适应的交通信号控制智能体,并采用一种新的状态空间——离散交通状态编码——其信息密度较高。This work applies modern deep reinforcement learning methods to build a truly adaptive traffic signal control agent in the traffic microsimulator SUMO, using a new state space, the discrete traffic state encoding, which is information dense.
本文综述了一些最具代表性的 LLM,包括三大主流 LLM 家族(GPT、LLaMA、PaLM),讨论其特性、贡献与局限性,并概述了构建与增强 LLM 的相关技术。This paper reviews some of the most prominent LLMs, including three popular LLM families (GPT, LLaMA, PaLM), and discusses their characteristics, contributions and limitations, and gives an overview of techniques developed to build, and augment LLMs.
本文对 LLM 的评估方法进行了全面综述,围绕三个关键维度展开:评估什么、在何处评估、如何评估,并为 LLM 评估领域的研究者提供了宝贵洞见。This paper presents a comprehensive review of these evaluation methods for LLMs, focusing on three key dimensions: what to evaluate, where to evaluate, and how to evaluate, and offers invaluable insights to researchers in the realm of LLMs evaluation.
该报告主张并例证了一种严谨且基于经验的方法来研究 AI 意识:依据获得最佳支持的神经科学意识理论,详细评估现有 AI 系统。This report argues for, and exemplifies, a rigorous and empirically grounded approach to AI consciousness: assessing existing AI systems in detail, in light of best-supported neuroscientific theories of consciousness.
该模型在效果上匹配基于优化的方法,同时实现近 800 倍加速,并以明显更少的参数量和更低的训练/推理开销超越 SOTA 可泛化模型的零样本性能,整体效率显著提升。This model matches optimization-based methods while delivering nearly 800x speedup, and surpasses the zero-shot performance of state-of-the-art generalizable models with markedly fewer parameters and reduced training/inference overhead, achieving an overall efficiency improvement.
本文提出 token 时间连续扩散 (TTCD),一种新的扩散语言模型,运行于连续空间,将高斯噪声确定性地映射到最终的 token canvas 而无需额外采样,并引入每个 token 时间的新概念。This paper introduces token time continuous diffusion (TTCD), a new diffusion language model which operates in continuous space, deterministically mapping Gaussian noise to a final token canvas with no further sampling, and incorporates a new notion of per-token times.
提出 Lucid,一个黑盒对抗框架,在严格的图像受限威胁模型下攻击多模态记忆管道,无需访问目标 MLLM、目标检索编码器或文本通道,揭示了多模态记忆管道中的结构性漏洞。Lucid is proposed, a black-box adversarial framework that compromises multimodal memory pipelines under a strictly image-bounded threat model, requiring no access to the target MLLM, target retrieval encoder, or the text channel, exposing a structural vulnerability in multimodal memory pipelines.
S1-Omni 基于 S1-Omni-Corpus 训练,覆盖 200 个科学任务并包含数百万推理样本,在 60 余个科学基准上进行了评估,为统一的科学建模提供了一条可行路径。S1-Omni is trained on S1-Omni-Corpus, which covers 200 scientific tasks and contains millions of reasoning samples, and is evaluated on over 60 scientific benchmarks, providing a practical path toward unified scientific modeling.
提出数据科学世界模型概念,通过基于当前工作流状态和候选操作预测环境状态转移来建模数据科学执行环境;提出DSWorld框架,结合结构化状态构建、成本感知路由、轻量级真实执行以及基于LLM的昂贵操作模拟器。The concept of Data Science World Model is introduced, which model the data science execution environment by predicting environment state transitions conditioned on current workflow states and candidate operations and proposes DSWorld, a practical framework that combines structured state construction, cost-aware routing, lightweight real execution, and an LLM-based simulator for expensive operations.
Xiaomi-Robotics-1是一个强大的机器人基础策略,能在复杂灵巧任务上以高数据效率高效微调,并在多个仿真基准上超越SOTA方法。Xiao-Robotics-1 serves as a strong robot foundation policy that can be efficiently fine-tuned on complex, dexterous tasks with high data efficiency and across multiple simulation benchmarks, Xiaomi-Robotics-1 outperforms state-of-the-art methods.
提出xHC(扩展型超连接),是首个在N=4之外实现有意义扩展的HC系列方法;引入xHC-Flash,将每个子层的内存访问量从73.5C降至40C(与mHC在N=4时的34C相当),同时保留完整xHC带来的性能增益。This work proposes xHC (Expanded Hyper-Connections), the first HC-family method to achieve meaningful expansion beyond $N{=}4$ and introduces xHC-Flash, which reduces the per-sublayer memory traffic from $73.5C$ to $40C, comparable to the $34C$ required by mHC at $N{=}4$, while retaining the gains of full xHC.
表明差值信号显著提升在策略蒸馏效果,提出新方法称为在策略差值蒸馏(OPD),使推理LLM仅需短暂的后训练即可获得强性能。It is shown that the delta signal substantially improves on-policy distillation and the new distillation method is referred to as On-Policy Delta Distillation (OPD), enabling reasoning LLMs to achieve strong performance with only a short post-training period.
VideoRAE是一种表征自编码器,利用冻结视频基础编码器的多尺度分层特征,并通过轻量级1D自注意力投影器进行压缩,验证了冻结VFM表征可作为通用且利于生成的视频潜变量。VideoRAE is a representation autoencoder that leverages multi-scale hierarchical features from a frozen video foundation encoder and compresses them with a lightweight 1D self-attention projector to validate frozen VFM representations as versatile and generation-friendly video latents.
RAGU是一个开源模块化GraphRAG引擎,通过将抽取与整合分离来解决抽取-整合问题:实体和关系经过两阶段类型化抽取、基于DBSCAN的去重、LLM摘要和Leiden社区检测。RAGU, an open-source modular GraphRAG engine, addresses extraction from consolidation by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection.
对一个旨在使魁北克汽车保险合同更易理解的SOTA RAG系统进行以人为中心的外在评估,结果显示该系统被视为认知均衡器,用户对系统所提供的自主感的重视程度甚至超过知识本身。A human-centric, extrinsic evaluation of a state-of-the-art Retrieval-Augmented Generation system, designed to make Quebec automobile insurance contracts more understandable, shows the system is perceived as a cognitive equalizer, and users value the sense of autonomy the system provides even more than the knowledge itself.
TARS是一个集成在Visual Studio Code中的LLM驱动Agent,通过直接锚定到被分析代码的自主解释来支持程序理解,基于轻量级心智理论范式构建。TARS is an LLM-powered agent integrated into Visual Studio Code that supports program comprehension through autonomous explanations anchored directly to the code under analysis, built around a lightweight Theory of Mind paradigm.
在一个 recipe 级操作机制中,fan-in Muon 在共享 KL 与 clipping 下支持更激进的稳定有效步长:该余量在优化仍有空间时最大,而在接近饱和、经 AdamW 调参后或使用 magnitude matching 时收缩。A recipe-level operating regime in which fan-in Muon supports a more aggressive stable effective step under shared KL and clipping is identified: the margin is largest when optimization headroom remains and contracts near saturation, after AdamW tuning, or under magnitude matching.
提出RESOURCE2SKILL框架,将教程视频、仓库、文章和参考制品等多模态资源蒸馏为软件Agent的可执行技能,并验证了多模态技能格式、层次化组织、来源多样性、选择策略与在线获取的价值。RESOURCE2SKILL is presented, a framework that distills multimodal resources, including tutorial videos, repositories, articles, and reference artifacts, into executable skills for software agents, and confirms the value of multimodal skill format, hierarchical organization, source diversity, selection strategy, and online acquisition.
本文回顾现有方法,并融合多种技术从数据与模型规模两方面扩展预训练,提出一条自动化流水线以构建专用、多样且经过筛选的图像数据集,替代自监督文献中常用的未筛选数据。This work revisits existing approaches and combines different techniques to scale the pretraining in terms of data and model size, and proposes an automatic pipeline to build a dedicated, diverse, and curated image dataset instead of uncurated data, as typically done in the self-supervised literature.
BLIP-2 在多种视觉-语言任务上取得 SOTA 性能,可训练参数远少于现有方法,并展现出遵循自然语言指令进行零样本图生文的新兴能力。BLIP-2 achieves state-of-the-art performance on various vision-language tasks, despite having significantly fewer trainable parameters than existing methods, and is demonstrated's emerging capabilities of zero-shot image-to-text generation that can follow natural language instructions.
一种面向语言模型推理的新框架 Tree of Thoughts (ToT),推广了流行的 Chain of Thought 提示方法,允许在作为问题求解中间步骤的连贯文本单元(thoughts)上进行探索。A new framework for language model inference, Tree of Thoughts (ToT), which generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving.
在 BIG-bench 上对 OpenAI 的 GPT 模型、Google 内部稠密 Transformer 架构及 Switch 风格稀疏 Transformer 进行评估,模型规模跨越百万至千亿参数,结果显示性能与校准均随规模提升而改善,但绝对水平仍然欠佳。Evaluation of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters finds that model performance and calibration both improve with scale, but are poor in absolute terms.
本文推出 ScanNet,一个 RGB-D 视频数据集,包含 1513 个场景中的 250 万视角,标注有三维相机位姿、表面重建与语义分割,并表明使用该数据可在多项三维场景理解任务上取得 SOTA 性能。This work introduces ScanNet, an RGB-D video dataset containing 2.5M views in 1513 scenes annotated with 3D camera poses, surface reconstructions, and semantic segmentations, and shows that using this data helps achieve state-of-the-art performance on several 3D scene understanding tasks.
对 SOTA LLM GPT-4 在医学能力考试与基准数据集上进行全面评估,并通过案例研究定性探索其行为,展示了 GPT-4 解释医学推理、为学生定制个性化讲解以及围绕病例交互式构造新反事实场景的能力。A comprehensive evaluation of GPT-4, a state-of-the-art LLM, on medical competency examinations and benchmark datasets and explores the behavior of the model qualitatively through a case study that shows the ability of G PT-4 to explain medical reasoning, personalize explanations to students, and interactively craft new counterfactual scenarios around a medical case.
本文提出 Toolformer,训练其决定调用哪些 API、何时调用、传入什么参数,以及如何将结果最佳地融入后续 token 预测,在多种下游任务上显著提升零样本性能。This paper introduces Toolformer, a model trained to decide which APIs to call, when to call them, what arguments to pass, and how to best incorporate the results into future token prediction, which achieves substantially improved zero-shot performance across a variety of downstream tasks.
研究发现 ChatGPT 在大多数任务上以零样本学习优于其他 LLM,在部分任务上甚至超过微调模型,并且对非拉丁文字语言的理解能力优于生成能力。It is found that ChatGPT outperforms LLMs with zero-shot learning on most tasks and even outperforms fine-tuned models on some tasks and is better at understanding non-Latin script languages than generating them.
本文介绍 Matterport3D,一个大规模 RGB-D 数据集,包含来自 90 个建筑物级场景共 194,400 张 RGB-D 图像的 10,800 个全景视图,可支持多种监督与自监督计算机视觉任务,包括关键点匹配、视角重叠预测、由彩色图像预测法线、语义分割和区域分类。Matterport3D is introduced, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400RGB-D images of 90 building-scale scenes that enable a variety of supervised and self-supervised computer vision tasks, including keypoint matching, view overlap prediction, normal prediction from color, semantic segmentation, and region classification.
本文对上述解决方案进行了详细综述,总结了其技术创新与实验结果,比较了各方法的优势与适用条件,并给出推荐方案。This article provides a detailed review of the solutions above, summarizing both the technical novelties and empirical results, and compares the benefits and requirements of the surveyed methodologies and provides recommended solutions.
本文详细介绍了 CNN 在多个方面的改进,包括层设计、激活函数、损失函数、正则化、优化与快速计算,并阐述了卷积神经网络在计算机视觉、语音与自然语言处理中的多种应用。This paper details the improvements of CNN on different aspects, including layer design, activation function, loss function, regularization, optimization and fast computation, and introduces various applications of convolutional neural networks in computer vision, speech and natural language processing.
本文介绍了 NOWJ 团队参加 COLIEE 2026 全部五项任务的方法与结果,采用基于稠密检索、注意力重排序和小样本提示 LLM 推理的检索增强生成框架。This paper presents the methodologies and results of the NOWJ team's participation across all five tasks of the COLIEE 2026 competition and adopts a retrieval-augmented generation framework with dense retrieval, attention-based reranking, and few-shot-prompted LLM reasoning.
本文认为安全 Agent 基准应在任务成功率之外,同时衡量经济效率与运维适配性,并提出成本感知、SOC 原生的评估方法,以更清晰地反映当前哪些模型具有实际可用价值,以及防御性 Agent 仍需改进的方向。It is argued that security-agent benchmarks should measure economic efficiency and operational fit alongside task success alongside task success, and cost-aware, SOC-native evaluations provide a clearer picture of which models are practically useful today and where defensive agents still need to improve.