研究库 论文知识库
Papers · organized/paper_cards

论文

148 张论文卡片 · 工程化 · 方法

开放获取 全部 绿色 · 1640
SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning
SimpleOPD:面向长上下文推理的简单、与 Tokenizer 无关的 On-Policy Distillation
arXiv:2608.14277 工程化 方法 OA · 绿色 被引 4 · S2

引入 student reference KL 损失并 mask 特殊终止 token 的 advantage,以缓解生成过长和频繁截断的问题;在 HLE 和 HiPhO 等科学 benchmark 上取得改进,表明 OPD 传递的推理能力可泛化至数学训练领域之外。This work introduces a student reference KL loss and mask the advantages of special termination tokens to mitigate the problem of excessive generation length and frequent truncation, and improves on science benchmarks such as HLE and HiPhO, suggesting that OPD transfers reasoning capabilities that generalize beyond the mathematical training domain.

DFM Mimir v1: An Open HRM Delivering Frontier Performance at 1B Parameters Using Only Permissible Post-Training Data
DFM Mimir v1:基于 HRM 架构、仅使用合规 Post-Training 数据实现 1B 参数前沿性能的开放模型
arXiv:2608.13517 工程化 方法 OA · 绿色 被引 1 · S2

提出 Mimir v1,一个基于 Hierarchical Reasoning Model(HRM)架构的 10 亿参数语言模型,从头训练,在英语上具有高度竞争力,并仅使用合规的后训练数据在丹麦语上创下新的 SOTA。Mimir v1 is introduced, a 1-billion-parameter language model based on the Hierarchical Reasoning Model (HRM) architecture that is trained from scratch and delivers highly competitive performance for English and sets a new state of the art for Danish using only permissible post-training data.

LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure
LittleLearner:在教学受控知识暴露下的语言模型
arXiv:2608.13545 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出 LITTLECURRICULUM,一个为美国小学课程量身定制的 88B token 精选预训练语料,并由此训练得到 LITTLELEARNER;该模型具备开放式评估所需的语言能力,同时其知识和能力边界清晰可映射到可解释的课程指南。This work introduces LITTLECURRICULUM, a curated 88B-token pretraining corpus tailored to U.S. elementary school material, which yields LITTLELEARNER, a model with sufficient language competence for open-ended evaluation, yet with clear knowledge and capability boundaries mapped to interpretable curriculum guidelines.

A Plug-and-Play 2D Motion Interface for Real-World Motion Language Models
面向真实世界 Motion Language Model 的即插即用 2D Motion 接口
arXiv:2608.15984 工程化 方法 OA · 绿色 被引 0 · S2 + OpenAlex

提出一个即插即用的 2D Motion Interface,使预训练于 3D 的 MoLM 能够在不修改或微调原始模型的情况下接受 2D 运动输入,并在 2D 运动任务上优于从头训练 MoLM。A plug-and-play 2D Motion Interface is introduced that enables 3D-pretrained MoLMs to accept 2D motion inputs without modifying or fine-tuning the original models and outperforms training MoLMs from scratch on 2D motions.