论文

本文提出 Omega-S——一种仅由权重矩阵计算得到的即插即用惩罚，无需先前任务数据、无需 Fisher 矩阵、无需保存旧权重副本，且单步开销不足 4%。Omega-S, a drop-in penalty computed from the weight matrix alone, is presented, a drop-in penalty computed from the weight matrix alone that needs no previous-task data, no Fisher matrix and no stored copy of the old weights and adds under 4% to the cost of a step.

对抗性 Fréchet 距离 (AdvFD) 用经过校准的对抗性学习表示来补充 FD-Loss 中的静态表示目标，通过对抗方式最大化真实样本与生成样本之间的 Fréchet 差异；同时引入真实特征白化，对尺度与协方差几何进行归一化，从而稳定极小极大优化。Adversarial Fr\'echet Distance (AdvFD), which complements the static representation targets in FD-Loss with a calibrated adversarially learned representation that adversarially maximizes the Fr\'echet discrepancy between real and generated samples, and introduces real-feature whitening, which normalizes its scale and covariance geometry and stabilizes the min--max optimization.

本文研究基于开源大语言模型的无参考多语言机器翻译后训练，发现 on-policy 蒸馏能够达到但无法超越结合 checkpoint 插值的强化学习所确立的质量前沿。This work studies reference-free post-training for multilingual machine translation with open large language models and finds that on-policy distillation reaches, but does not surpass, the quality frontier achieved by RL with checkpoint interpolation.

本文引入静止状态 (rest-state) 公式化方法，从单一闭合构型重建关节物体——这是一种固有的不适定设定，几何、语义与运动先验在此弥补运动线索的缺失。This work introduces a rest-state formulation that reconstructs articulated objects from a single closed configuration, an inherently ill-posed setting where geometry, semantics, and motion priors compensate for the absence of motion cues.

本工作提出在海量文本语料上使用新的自监督目标 PEGASUS 对大型 Transformer 编码器-解码器模型进行预训练，并证明其在所有 12 个下游数据集上按 ROUGE 分数衡量均取得 SOTA 性能This work proposes pre-training large Transformer-based encoder-decoder models on massive text corpora with a new self-supervised objective, PEGASUS, and demonstrates it achieves state-of-the-art performance on all 12 downstream datasets measured by ROUGE scores.

提出了能够平衡"延迟告警的上下文敏感成本"与"打断成本"的模型与推理流程，并通过对用户活动与通知内容的分析，描述了在不确定性下推理此类成本所面临的挑战Models and inference procedures that balance the context-sensitive costs of deferring alerts with the cost of interruption are presented and the challenge of reasoning about such costs under uncertainty via an analysis of user activity and the content of notifications is described.

本文提供了参数空间探索能够改进 LLM 强化学习的证据，并提出称为扰动参数策略优化（3PO）的方法族，使用不同的采样策略和不同的 rollout 分组进行 reward 估计。Evidence that parameter-space exploration can improve reinforcement learning for LLMs is presented, and a family of methods called Perturbed Parameter Policy Optimization (3PO) is introduced which use different sampling strategies and different rollout grouping for reward estimation.

本工作训练了一个预测的计算最优模型 Chinchilla，使用与 Gopher 相同的计算预算，但参数量为 70B、数据量为 4 倍，达到 SOTA 平均准确率，比 Gopher 提升超过 7%。This work trains a predicted compute-optimal model, Chinchilla, that uses the same compute budget as Gopher but with 70B parameters and 4$\times$ more more data, and reaches a state-of-the-art average accuracy, greater than a 7% improvement over Gopher.

一种具有固定大小记忆的循环 Transformer 架构，可泛化 sliding-window attention，同时在训练期间保持并行性，并在验证 loss 和下游预训练 benchmark 上优于 sliding-window 和 latent recurrent Transformer 基线。A recurrent Transformer architecture with fixed-size memory that generalizes sliding-window attention while remaining parallelizable during training and improves validation loss and downstream pretraining benchmarks over sliding-window and latent recurrent transformer baselines.

本文提出一种权重裁剪的替代方案：对 critic 相对于其输入的梯度范数施加惩罚。其性能优于标准 WGAN，能以几乎无需调参的方式稳定训练多种 GAN 架构。This work proposes an alternative to clipping weights: penalize the norm of gradient of the critic with respect to its input, which performs better than standard WGAN and enables stable training of a wide variety of GAN architectures with almost no hyperparameter tuning.

首个同时使用 LLM 推理和 tag-aware 翻译来明确处理并评估英罗 MT 中性别偏见的方法。This is the first method to explicitly address and evaluate gender bias in English-Romanian MT using both LLM inference and tag-aware translation.

引入 student reference KL 损失并 mask 特殊终止 token 的 advantage，以缓解生成过长和频繁截断的问题；在 HLE 和 HiPhO 等科学 benchmark 上取得改进，表明 OPD 传递的推理能力可泛化至数学训练领域之外。This work introduces a student reference KL loss and mask the advantages of special termination tokens to mitigate the problem of excessive generation length and frequent truncation, and improves on science benchmarks such as HLE and HiPhO, suggesting that OPD transfers reasoning capabilities that generalize beyond the mathematical training domain.

提出 Mimir v1，一个基于 Hierarchical Reasoning Model（HRM）架构的 10 亿参数语言模型，从头训练，在英语上具有高度竞争力，并仅使用合规的后训练数据在丹麦语上创下新的 SOTA。Mimir v1 is introduced, a 1-billion-parameter language model based on the Hierarchical Reasoning Model (HRM) architecture that is trained from scratch and delivers highly competitive performance for English and sets a new state of the art for Danish using only permissible post-training data.

提出 LITTLECURRICULUM，一个为美国小学课程量身定制的 88B token 精选预训练语料，并由此训练得到 LITTLELEARNER；该模型具备开放式评估所需的语言能力，同时其知识和能力边界清晰可映射到可解释的课程指南。This work introduces LITTLECURRICULUM, a curated 88B-token pretraining corpus tailored to U.S. elementary school material, which yields LITTLELEARNER, a model with sufficient language competence for open-ended evaluation, yet with clear knowledge and capability boundaries mapped to interpretable curriculum guidelines.

提出一个即插即用的 2D Motion Interface，使预训练于 3D 的 MoLM 能够在不修改或微调原始模型的情况下接受 2D 运动输入，并在 2D 运动任务上优于从头训练 MoLM。A plug-and-play 2D Motion Interface is introduced that enables 3D-pretrained MoLMs to accept 2D motion inputs without modifying or fine-tuning the original models and outperforms training MoLMs from scratch on 2D motions.