提出 ENTRAP-VL(ENTRainment Assessment Probe for Vision and Language),一个由人工策展的 1,500 条数据的数据集,涵盖八个类别,按一个跨双轴的分类体系组织,并划分为文本诱发流和视觉诱发流。ENTRAP-VL (ENTRainment Assessment Probe for Vision and Language), a manually curated dataset of 1,500 items across eight categories, organized by a taxonomy that spans two axes and split into a textual-entrainment stream and a visual-entrainment stream, is introduced.
论文
1686 张论文卡片 · OA 绿色
结果表明,基于逻辑的神经架构成为资源受限脑机接口的实用范式,在原生满足便携式边缘部署的延迟和内存约束的同时,取得了有竞争力甚至更优的性能。The results establish logic-based neural architectures as a practical paradigm for resource-constrained brain-computer interfaces, achieving competitive or superior performance while natively satisfying the latency and memory constraints of portable edge deployment.
论证了经济层面的依据:天真的上下文累积会使 token 成本随对话长度呈二次增长,粗糙的摘要以线性成本换取准确率的断崖式下降,唯有经过验证的压缩才能以线性成本保持保真度。The economic case is made: naive context accumulation grows token cost quadratically in conversation length, crude summarization buys linear cost at the price of an accuracy cliff, and only validated compaction achieves linear cost with preserved fidelity.
提出 ProVisE(Protocolized Visual Evaluation),一个与基准无关的框架,通过受协议约束的视觉问答从图像生成模型中抽取答案,并将其解析为与原始指标兼容的结构化预测,揭示了像素空间表达与基于文本推理的互补优势。ProVisE (Protocolized Visual Evaluation), a benchmark-agnostic framework that elicits protocol-constrained visual answers from image-generation models and parses them into structured predictions compatible with original metrics, is proposed and revealed, revealing complementary strengths of pixel-space expression and text-based reasoning.
研究揭示,正弦激活会诱发谐波线谱,为循环展开如何丰富隐式神经表示(INR)的有效频谱支撑提供了频谱层面的解释。It is revealed that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support in implicit neural representations (INRs).
与经典强化学习基线相比,从试错经验中进行上下文学习并随后进行经验蒸馏(Experience Distillation),以至少 9.6× 更少的环境样本达到了相当的性能。Compared with classical reinforcement-learning baselines, in-context learning from trial-and-error experience followed by Experience Distillation matches their performance with at least \(9.6\times\) fewer environment samples.
提出 ReferTrack,一种"先指代后跟踪"的范式,仅使用单个前向摄像头完成 EVT grounding,在四足机器人和人形机器人上的真实部署验证了其稳健的 sim-to-real 迁移能力。ReferTrack is introduced, a referring-then-tracking paradigm that grounds EVT using a single forward-facing camera, and real-world deployments on legged and humanoid robots validate its robust sim-to-real transfer capabilities.
本文提出一个框架,将静态的单轮任务转化为动态多轮对话,其中用户意图在多轮间持续演化,同时保留每个任务原有的评估协议,使现有基准能够在无需新增标注的情况下作为受控测试平台被复用。This work introduces a framework that transforms static, single-turn tasks into dynamic multi-turn conversations in which the user's intent evolves across turns, while preserving each task's original evaluation protocol, enabling existing benchmarks to be reused as controlled testbeds without new annotation.
提出 Robostral Navigate,一个围绕该可扩展性目标构建的 8B 视觉语言模型,仅消费单目 RGB 图像流——这是机器人平台中最普及的传感器——通过在当前相机画面中指向下一目标位置来预测航点。Robostral Navigate, an 8B vision-language model built around this scalability objective, is introduced, which consumes only a stream of monocular RGB images - the most ubiquitous sensor across robotic platforms and predicts waypoints by pointing to the next target location in the current camera view.
本文提出 Color Pass-Through,一个端到端可学习的框架,直接在采集图像上运行,将相机和显示器视为耦合系统进行联合处理,而非单独校准。This work proposes Color Pass-Through, an end-to-end learned framework that operates directly on captured images, to treat the camera and display as a coupled system rather than calibrating them in isolation.
本文提出 K12-KGraph,一个从人民教育出版社官方教材中提取的、与课程对齐的知识图谱,覆盖小学、初中和高中阶段的数学、物理、化学和生物,并由此衍生出 K12-Bench,一个包含 23,640 道题的多选基准,涵盖五类任务族,表明文本监督与视觉监督具有互补性。This work introduces K12-KGraph, a curriculum-aligned knowledge graph extracted from official People's Education Press textbooks in mathematics, physics, chemistry, and biology across primary, middle, and high school, and derives K12-Bench, a 23,640-question multi-select benchmark with five task families, showing that textual and visual supervision are complementary.
提出结构化动态模型(SDM),通过未来特征预测,显式地将时间变化的主导来源与残差动态分离开来,而非使用单一纠缠的隐变量或非结构化的、空间密集的转移 token 来表示视频变化。The Structured Dynamics Model (SDM) is proposed, which explicitly separates the dominant source of temporal change from residual dynamics through future-feature prediction, rather than representing video change with a single entangled latent or with unstructured, spatially dense transition tokens.
本文提出 SANA-Video 2.0,一个混合视频扩散 Transformer,在统一架构下实例化 5B 和 14B 两种规模,以显著降低的计算成本恢复了 softmax 级别的表达能力,解锁了可扩展的长时长、高分辨率视频生成。This work introduces SANA-Video 2.0, a hybrid video diffusion transformer instantiated at 5B and 14B scales under a unified architecture that recovers softmax-level expressiveness at substantially reduced cost, unlocking scalable long, high resolution video generation.
本文设计 Finance-LaTeX SKILL,一个基于专家知识合成复杂版面金融文档的 skill,并提出 FinanceComplexQA,一个全面、贴近真实场景的金融文档开放式生成基准。This work designs Finance-LaTeX SKILL, a skill for synthesizing financial documents with complex layouts based on expert knowledge, and introduces FinanceComplexQA, a comprehensive open-ended generation benchmark for financial documents that closely resembles real-world scenarios.
ReOPD 将昂贵的 Agent-环境交互转化为可复用的离线资源,实现跨工具、任务和环境的可扩展蒸馏,在学生训练期间保持或提升 OPD 级别的准确率,零次工具调用,并且每次 rollout 至少比 OPD 快 4×。ReOPD turns expensive agent-environment interaction into a reusable offline resource, enabling scalable distillation across tools, tasks, and environments and preserves or improves OPD-level accuracy, uses zero tool calls during student training, and is at least 4$\times faster per rollout than OPD.
本文描述了一份以模式形式呈现的 prompt 工程技巧目录,这些技巧已被用于解决与 LLMs 对话时的常见问题,以改进 LLM 对话的输出。A catalog of prompt engineering techniques presented in pattern form that have been applied to solve common problems when conversing with LLMs to improve the outputs of LLM conversations is described.
研究发现,ChatGPT 最成功地被用作数学助手,用于查询事实、充当数学搜索引擎和知识库接口;GPT-4 还可被用于本科水平的数学问题,但在研究生难度的题目上表现不佳。It is found that ChatGPT can be used most successfully as a mathematical assistant for querying facts, acting as a Mathematical search engine and knowledge base interface, and GPT-4 can additionally be used for undergraduate-level mathematics but fails on graduate-level difficulty.
本文进行了迄今为止对 Code LLMs 最全面的评估,结果显示 StarCoderBase 在支持多编程语言的开放 Code LLMs 中表现最优,并且能够匹敌或超越 OpenAI code-cushman-001 模型。This work performs the most comprehensive evaluation of Code LLMs to date and shows that StarCoderBase outperforms every open Code LLM that supports multiple programming languages and matches or outperforms the OpenAI code-cushman-001 model.
本文显著推进了针对已对齐语言模型的对抗攻击 SOTA,并提出了关于如何防止此类系统生成不良信息的重要问题。This work significantly advances the state-of-the-art in adversarial attacks against aligned language models, raising important questions about how such systems can be prevented from producing objectionable information.
本文旨在建立一套系统化的开放问题与应用成果清单,以便机器学习研究者更快地理解该领域的现状并开展有效工作。This paper aims to establish a systematic set of open problems and application successes so that ML researchers can comprehend the field's current state more quickly and become productive.
EvalPlus——一个用于严格基准测试 LLM 生成代码功能正确性的代码合成评估框架,通过 LLM 与基于 mutation 的策略驱动的自动测试输入生成器,为给定评估数据集补充大量新生成的测试用例。EvalPlus -- a code synthesis evaluation framework to rigorously benchmark the functional correctness of LLM-synthesized code and augments a given evaluation dataset with large amounts of test-cases newly produced by an automatic test input generator, powered by both LLM and mutation-based strategies.
实证研究表明 AutoGen 框架在多个示例应用中有效,应用领域涵盖数学、编码、问答、运筹学、在线决策、娱乐等。Empirical studies demonstrate the effectiveness of the AutoGen framework in many example applications, with domains ranging from mathematics, coding, question answering, operations research, online decision-making, entertainment, etc.
PaLM 2 是一个新的 SOTA 语言模型,相比其前身 PaLM 具有更强的多语言和推理能力,并具备更高的计算效率,能够在不增加额外开销或影响其他能力的前提下在推理时控制输出毒性。PaLM 2 is a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM and enables inference-time control over toxicity without additional overhead or impact on other capabilities.
提出 OpenForgeRL,一个用于在多样化环境中端到端训练基于 harness 的 Agent 的开源框架,并在多种复杂的 harness 和环境中得到验证,涵盖工具/爪型 Agent 以及多模态 GUI 浏览器和计算机使用 Agent。OpenForgeRL is presented, an open-source framework for training harness-based agents end-to-end in diverse environments, and validated across diverse, complex harnesses and environments, spanning tool/claw-based agents and multimodal GUI browser- and computer-use agents.
本文在使用 SOTA CNN 的情况下,实现了 16–24 倍的网络压缩,仅带来 1% 的分类准确率损失,并发现针对存储开销最大的全连接层进行压缩时,向量量化方法相比现有矩阵分解方法具有明显优势。This paper is able to achieve 16-24 times compression of the network with only 1% loss of classification accuracy using the state-of-the-art CNN, and finds in terms of compressing the most storage demanding dense connected layers, vector quantization methods have a clear gain over existing matrix factorization methods.
本文提出通过熵正则化对 Wasserstein 距离进行平滑处理,由此得到一个严格凸的目标函数,其梯度可借助矩阵缩放算法以显著更低的计算代价求得。The Wasserstein distance is proposed to be smoothed with an entropic regularizer and recover in doing so a strictly convex objective whose gradients can be computed for a considerably cheaper computational cost using matrix scaling algorithms.
本综述尝试连接并系统化现有迁移学习研究,全面总结与阐释迁移学习的机制与策略,帮助读者更好地理解当前研究现状与思路。This survey attempts to connect and systematize the existing transfer learning research studies, as well as to summarize and interpret the mechanisms and the strategies of transfer learning in a comprehensive way, which may help readers have a better understanding of the current research status and ideas.
全面概述了 LLM 幻觉检测方法与基准,并指出 LLM 幻觉领域有前景的研究方向,包括大视觉-语言模型中的幻觉以及 LLM 幻觉中的知识边界理解。A thorough overview of hallucination detection methods and benchmarks is presented and the promising research directions on LLM hallucinations are highlighted, including hallucination in large vision-language models and understanding of knowledge boundaries in LLM hallucinations.
所提出的通用度量空间搜索索引显著优于此前开源的 SOTA 纯向量方法,且该算法与 skip list 结构的相似性便于直接实现均衡的分布式部署。The proposed general metric space search index is able to strongly outperform previous opensource state-of-the-art vector-only approaches and similarity of the algorithm to the skip list structure allows straightforward balanced distributed implementation.
本综述旨在阐明 PFMs 在可扩展性、安全性、逻辑推理能力、跨领域学习能力以及面向 AGI 的友好交互能力方面的研究。This survey aims to shed light on the research of the PFMs on scalability, security, logical reasoning ability, cross-domain learning ability, and the user-friendly interactive ability for artificial general intelligence.
本综述对图嵌入文献进行全面回顾,并提出两种图嵌入分类法,分别对应不同图嵌入问题设置中的挑战以及现有工作如何在解决方案中应对这些挑战。This survey conducts a comprehensive review of the literature in graph embedding and proposes two taxonomies ofGraph embedding which correspond to what challenges exist in differentgraph embedding problem settings and how the existing work addresses these challenges in their solutions.
本综述从数据管理视角对数据收集进行全面研究,提供了相关操作的研究全景图、何时使用何种技术的指导原则,并识别出值得关注的研究挑战。This survey performs a comprehensive study of data collection from a data management point of view, providing a research landscape of these operations, guidelines on which technique to use when, and identify interesting research challenges.
提出一个模型,基于图像区域上的 CNN、句子上的双向 RNN 以及通过多模态嵌入对齐两种模态的结构化目标,生成图像及其区域的自然语言描述。A model that generates natural language descriptions of images and their regions based on a novel combination of Convolutional Neural Networks over image regions, bidirectional Recurrent Neural Networks over sentences, and a structured objective that aligns the two modalities through a multimodal embedding is presented.
在大规模复杂的移动边缘网络中,涉及具有不同约束的异构设备,这为大规模 FL 实施带来了通信成本、资源分配以及隐私安全方面的挑战。In a large-scale and complex mobile edge network, heterogeneous devices with varying constraints are involved, this raises challenges of communication costs, resource allocation, and privacy and security in the implementation of FL at scale.
本综述旨在通过对基本思想与关键原则的系统回顾以及对不同算法与技术的合理分类,提供在线机器学习文献的全面综述。This survey aims to provide a comprehensive survey of the online machine learning literatures through a systematic review of basic ideas and key principles and a proper categorization of different algorithms and techniques.
提出 Manhattan NMF(MahNMF),通过最小化 $X$ 与 $W^T H$ 之间的 Manhattan 距离建模重尾 Laplacian 噪声,并以迭代方式提升 MahNMF 及其扩展的近似精度。Manhattan NMF (MahNMF) is presented which minimizes the Manhattan distance between $X and $W^T H$ for modeling the heavy tailed Laplacian noise and improves the approximation accuracy iteratively for both MahNMF and its extensions.