论文

FinMMEval 2026 Task 2 围绕多语言证据评估金融领域的短答问答，采用文档 RAG、跨语言证据处理、结构化提示、答案压缩与验证策略。FinMMEval 2026 Task 2 evaluates short-answer financial question answering over multilingual evidence over multilingual evidence using document retrieval-augmented generation, cross-lingual evidence handling, structured prompting, answer compression, and validation strategies.

Self Gradient Forcing（SGF）是一种两阶段训练策略，在原生自回归训练目标内恢复缺失的"记忆写入"监督信号，通过对未来视频 latent 的损失来训练模型将上下文编码为更有效的因果记忆。Self Gradient Forcing (SGF), a two-pass training strategy that restores this missing memory-writing supervision within the native autoregressive training objective, using losses on future video latents to train the model to encode context into more effective causal memory.

本文提出 Trace，一个面向多领域视觉推理的、由分类体系引导的环境，其将任务构建分解为场景语法与可执行任务程序，将视觉呈现与答案计算解耦，并提供了广泛的程序化训练可迁移到生成任务分布之外的证据。Trace is introduced, a taxonomy-guided environment for multidomain visual reasoning that factorizes task construction into a scene grammar and an executable task program, separating visual realization from answer computation, providing evidence that broad procedural training can transfer beyond the generated task distributions.

该设计将 hypernetwork 的注入能力与目标模型的通用能力解耦，首次实现了对 hypernetwork 架构 scaling law 的严格研究，并提供了首个基于实证的 scaling law，用以指导大语言模型中面向事实推理的 hypernetwork 设计。The design decouples the hypernetwork's injection capacity from the target model's general capability, enabling, for the first time, a rigorous study of scaling laws for hypernetwork architectures, and provides the first empirically grounded scaling laws to guide hypernetworks for factual reasoning in large language models.

人类视觉是一个闭环：注视点不断被中间假设而非单一快照持续重定向。数十年的心理物理学与认知科学研究表明，主动观察对多种任务至关重要。当代多模态大语言模型 (MLLM) 是否进行主动观察，是一个现有视觉语言基准无法回答的经验问题。我们提出 ActiveVision，一个使 MLLM 主动观察可度量的基准，包含 3 个类别共 17 个任务，任务设计强制进行重复视觉感知……Human vision is a closed loop: gaze is continuously redirected by intermediate hypotheses rather than a single snapshot. Decades of psychophysics and cognitive science have argued that this active observation is essential for a wide range of tasks. Whether today's multimodal large language models (MLLMs) exercise active observation is an empirical question that current vision-language benchmarks do not answer. We introduce ActiveVision, a benchmark that makes active observation measurable for MLLMs, comprising 17 tasks across 3 categories. Tasks are designed to force repeated visual perception

本文提出 \method，一种无需训练的稀疏注意力系统，可在多 GPU 序列并行下提升自适应稀疏注意力的分布式执行效率。This work presents \method, a training-free sparse-attention system that improves the distributed execution efficiency of adaptive sparse attention under multi-GPU sequence parallelism.

本文提出 Anchor-Align，通过两个目标增强 BC：Vision-Language Anchoring 从冻结 VLM 副本中蒸馏逐层表示以防止该漂移；Language-Action Alignment 将每个动作目标转换为离散的运动方向标签，并在同一机器人观测上联合训练语言与动作预测。Anchor-Align is proposed, which augments BC with two objectives: Vision-Language Anchoring distills layer-wise representations from a frozen VLM copy to prevent this drift, and Language-Action Alignment converts each action target into a discrete motion-direction label and jointly trains language and action prediction on the same robot observation.

提出 DocOps，一种确定性可验证的评估框架，基于分层分类法，将受真实实践启发的文档操作分解为原子维度与逐级递增的工作流复杂度，从而揭示 Agent 在维护全局文档一致性方面的能力边界。DocOps is introduced, a deterministically verifiable evaluation framework underpinned by a hierarchical taxonomy that deconstructs document operations inspired by real-world practices into atomic dimensions and escalating workflow complexities that exposes the capability boundaries of agents in maintaining global document consistency.

提出两项审计协议——grounding and truth 对比以及 swap to an independent evaluator，以及 RECAP（Readable Encodings via Co-trained Auxiliary Predictors），即与目标模型联合训练的线性头，用于保持指定内容的可解码性。Two audit protocols, the comparison of grounding and truth and the swap to an independent evaluator, and RECAP (Readable Encodings via Co-trained Auxiliary Predictors), linear heads trained alongside the target model to keep designated content decodable are contributed.

GPT-3 在多个 NLP 数据集上取得了强劲表现，包括翻译、问答和完形填空任务，以及若干需要即时推理或领域适应的任务，例如乱序词重组、在句子中使用新词、或执行三位数算术运算。GPT-3 achieves strong performance on many NLP datasets, including translation, question-answering, and cloze tasks, as well as several tasks that require on-the-fly reasoning or domain adaptation, such as unscrambling words, using a novel word in a sentence, or performing 3-digit arithmetic.

本文设计了一种直接处理点云的新型神经网络，较好地尊重了输入点的置换不变性，并为从物体分类、部件分割到场景语义解析等应用提供了统一架构。This paper designs a novel type of neural network that directly consumes point clouds, which well respects the permutation invariance of points in the input and provides a unified architecture for applications ranging from object classification, part segmentation, to scene semantic parsing.

本文开发并发布了 Llama 2，这是一系列参数规模从 70 亿到 700 亿不等的预训练与微调大语言模型（LLMs），有望成为闭源模型的合适替代品。This work develops and releases Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters, which may be a suitable substitute for closed-source models.

本研究证实了激活函数之间存在统计显著的性能差异，从而再次确认了非饱和函数在深度架构中的必要性，并恢复了对此前文献的恰当历史归属。This study confirms a statistically significant performance variance among activations, thus reaffirming the necessity of non-saturating functions in deep architectures, and restores proper historical attribution to prior literature.

一种基于二部交互图上可微分消息传递的图自编码器框架，在标准协同过滤基准上表现出竞争力，并优于近期的 SOTA 方法。A graph auto-encoder framework based on differentiable message passing on the bipartite interaction graph that shows competitive performance on standard collaborative filtering benchmarks and outperforms recent state-of-the-art methods.

本文介绍 MLlib，Spark 的开源分布式机器学习库，可为多种学习场景提供高效功能，并包含若干底层的统计、优化和线性代数原语。MLlib is presented, Spark's open-source distributed machine learning library that provides efficient functionality for a wide range of learning settings and includes several underlying statistical, optimization, and linear algebra primitives.

本文提出了一个自然场景文本识别框架，无需任何人工标注数据，并以整体方式对整幅图像进行单词识别，区别于过去基于字符的识别系统。This work presents a framework for the recognition of natural scene text that does not require any human-labelled data, and performs word recognition on the whole image holistically, departing from the character based recognition systems of the past.

本文提出了一种新的解码策略——self-consistency，用于替代思维链 prompt 中使用的朴素贪心解码：首先采样一组多样化的推理路径，而非仅取贪心路径，然后通过对采样路径进行边缘化来选择最一致的答案。This paper proposes a new decoding strategy, self-consistency, to replace the naive greedy decoding used in chain-of-thought prompting that first samples a diverse set of reasoning paths instead of only taking the greedy one, and then selects the most consistent answer by marginalizing out the sampled reasoning paths.

提出 ENTRAP-VL（ENTRainment Assessment Probe for Vision and Language），一个由人工策展的 1,500 条数据的数据集，涵盖八个类别，按一个跨双轴的分类体系组织，并划分为文本诱发流和视觉诱发流。ENTRAP-VL (ENTRainment Assessment Probe for Vision and Language), a manually curated dataset of 1,500 items across eight categories, organized by a taxonomy that spans two axes and split into a textual-entrainment stream and a visual-entrainment stream, is introduced.

结果表明，基于逻辑的神经架构成为资源受限脑机接口的实用范式，在原生满足便携式边缘部署的延迟和内存约束的同时，取得了有竞争力甚至更优的性能。The results establish logic-based neural architectures as a practical paradigm for resource-constrained brain-computer interfaces, achieving competitive or superior performance while natively satisfying the latency and memory constraints of portable edge deployment.

论证了经济层面的依据：天真的上下文累积会使 token 成本随对话长度呈二次增长，粗糙的摘要以线性成本换取准确率的断崖式下降，唯有经过验证的压缩才能以线性成本保持保真度。The economic case is made: naive context accumulation grows token cost quadratically in conversation length, crude summarization buys linear cost at the price of an accuracy cliff, and only validated compaction achieves linear cost with preserved fidelity.

提出 ProVisE（Protocolized Visual Evaluation），一个与基准无关的框架，通过受协议约束的视觉问答从图像生成模型中抽取答案，并将其解析为与原始指标兼容的结构化预测，揭示了像素空间表达与基于文本推理的互补优势。ProVisE (Protocolized Visual Evaluation), a benchmark-agnostic framework that elicits protocol-constrained visual answers from image-generation models and parses them into structured predictions compatible with original metrics, is proposed and revealed, revealing complementary strengths of pixel-space expression and text-based reasoning.

研究揭示，正弦激活会诱发谐波线谱，为循环展开如何丰富隐式神经表示（INR）的有效频谱支撑提供了频谱层面的解释。It is revealed that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support in implicit neural representations (INRs).

与经典强化学习基线相比，从试错经验中进行上下文学习并随后进行经验蒸馏（Experience Distillation），以至少 9.6× 更少的环境样本达到了相当的性能。Compared with classical reinforcement-learning baselines, in-context learning from trial-and-error experience followed by Experience Distillation matches their performance with at least \(9.6\times\) fewer environment samples.

提出 ReferTrack，一种"先指代后跟踪"的范式，仅使用单个前向摄像头完成 EVT grounding，在四足机器人和人形机器人上的真实部署验证了其稳健的 sim-to-real 迁移能力。ReferTrack is introduced, a referring-then-tracking paradigm that grounds EVT using a single forward-facing camera, and real-world deployments on legged and humanoid robots validate its robust sim-to-real transfer capabilities.

本文提出一个框架，将静态的单轮任务转化为动态多轮对话，其中用户意图在多轮间持续演化，同时保留每个任务原有的评估协议，使现有基准能够在无需新增标注的情况下作为受控测试平台被复用。This work introduces a framework that transforms static, single-turn tasks into dynamic multi-turn conversations in which the user's intent evolves across turns, while preserving each task's original evaluation protocol, enabling existing benchmarks to be reused as controlled testbeds without new annotation.

提出 Robostral Navigate，一个围绕该可扩展性目标构建的 8B 视觉语言模型，仅消费单目 RGB 图像流——这是机器人平台中最普及的传感器——通过在当前相机画面中指向下一目标位置来预测航点。Robostral Navigate, an 8B vision-language model built around this scalability objective, is introduced, which consumes only a stream of monocular RGB images - the most ubiquitous sensor across robotic platforms and predicts waypoints by pointing to the next target location in the current camera view.

本文提出 Color Pass-Through，一个端到端可学习的框架，直接在采集图像上运行，将相机和显示器视为耦合系统进行联合处理，而非单独校准。This work proposes Color Pass-Through, an end-to-end learned framework that operates directly on captured images, to treat the camera and display as a coupled system rather than calibrating them in isolation.

本文提出 K12-KGraph，一个从人民教育出版社官方教材中提取的、与课程对齐的知识图谱，覆盖小学、初中和高中阶段的数学、物理、化学和生物，并由此衍生出 K12-Bench，一个包含 23,640 道题的多选基准，涵盖五类任务族，表明文本监督与视觉监督具有互补性。This work introduces K12-KGraph, a curriculum-aligned knowledge graph extracted from official People's Education Press textbooks in mathematics, physics, chemistry, and biology across primary, middle, and high school, and derives K12-Bench, a 23,640-question multi-select benchmark with five task families, showing that textual and visual supervision are complementary.

本文描述了一份以模式形式呈现的 prompt 工程技巧目录，这些技巧已被用于解决与 LLMs 对话时的常见问题，以改进 LLM 对话的输出。A catalog of prompt engineering techniques presented in pattern form that have been applied to solve common problems when conversing with LLMs to improve the outputs of LLM conversations is described.

研究发现，ChatGPT 最成功地被用作数学助手，用于查询事实、充当数学搜索引擎和知识库接口；GPT-4 还可被用于本科水平的数学问题，但在研究生难度的题目上表现不佳。It is found that ChatGPT can be used most successfully as a mathematical assistant for querying facts, acting as a Mathematical search engine and knowledge base interface, and GPT-4 can additionally be used for undergraduate-level mathematics but fails on graduate-level difficulty.

本文进行了迄今为止对 Code LLMs 最全面的评估，结果显示 StarCoderBase 在支持多编程语言的开放 Code LLMs 中表现最优，并且能够匹敌或超越 OpenAI code-cushman-001 模型。This work performs the most comprehensive evaluation of Code LLMs to date and shows that StarCoderBase outperforms every open Code LLM that supports multiple programming languages and matches or outperforms the OpenAI code-cushman-001 model.

本文显著推进了针对已对齐语言模型的对抗攻击 SOTA，并提出了关于如何防止此类系统生成不良信息的重要问题。This work significantly advances the state-of-the-art in adversarial attacks against aligned language models, raising important questions about how such systems can be prevented from producing objectionable information.

本文旨在建立一套系统化的开放问题与应用成果清单，以便机器学习研究者更快地理解该领域的现状并开展有效工作。This paper aims to establish a systematic set of open problems and application successes so that ML researchers can comprehend the field's current state more quickly and become productive.

EvalPlus——一个用于严格基准测试 LLM 生成代码功能正确性的代码合成评估框架，通过 LLM 与基于 mutation 的策略驱动的自动测试输入生成器，为给定评估数据集补充大量新生成的测试用例。EvalPlus -- a code synthesis evaluation framework to rigorously benchmark the functional correctness of LLM-synthesized code and augments a given evaluation dataset with large amounts of test-cases newly produced by an automatic test input generator, powered by both LLM and mutation-based strategies.

实证研究表明 AutoGen 框架在多个示例应用中有效，应用领域涵盖数学、编码、问答、运筹学、在线决策、娱乐等。Empirical studies demonstrate the effectiveness of the AutoGen framework in many example applications, with domains ranging from mathematics, coding, question answering, operations research, online decision-making, entertainment, etc.