研究库 论文知识库
Papers · organized/paper_cards

论文

8 张论文卡片 · 工程化 · 评测集 · OA 绿色

开放获取 全部 绿色 · 1640
Training Leaves Traces: Centered Residual Signatures for Language Model Lineage Verification
训练留痕:用于语言模型谱系验证的居中残差签名
arXiv:2608.14929 工程化 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

结果为兼容的开源权重语言模型检查点建立了一种被动、无需数据的溯源信号,且该投影配对信号出现在六个及更多语言模型系列中The results establish a passive, data-free provenance signal for compatible open-weight language-model checkpoints, and the projection-pairing signal appears across six language-model families and beyond.

The More Popular, The Harder to Forget: Adaptive Popularity for LLM Unlearning
越流行越难遗忘:面向 LLM 遗忘的自适应流行度方法
arXiv:2608.14229 工程化 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

提出 AdaPop(自适应流行度)方法,将局部 token 置信度与源自外部代理的逐事实流行度相关指数相结合,并通过双上升控制器在每个 epoch 调整 retain 惩罚来自动平衡遗忘与保留。The AdaPop (Adaptive Popularity) method is proposed, which combines local token confidence with a per-fact popularity-dependent exponent derived from an external proxy, and automates the forget-retain balance via a dual-ascent controller that adjusts the retain penalty each epoch.

Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents
获取、修复、保留:面向小模型对话游戏 Agent 的诊断驱动后训练方案
arXiv:2608.28458 工程化 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

结果表明,广泛的 SFT 带来模型大部分能力提升;当失败检测精准时,turn-local 监督可发挥作用,且观察到的迁移主要集中在同族模型之间。The results suggest that broad SFT brings most of the model's capability improvement; turn-local supervision can be effective when failure detection is precise, with observed transfer concentrated primarily within-family.

From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix
从生产流量到后训练:构建覆盖企业请求组合的自托管 LLM
arXiv:2609.01572 工程化 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

数据驻留约束迫使企业自托管 LLM,但不断引入新模型而不下线旧模型会扩张服务集群,分散有限的 GPU 池。我们通过沿指令遵循、函数调用和内部任务分布三个维度,针对生产错误分析所发现的质量差距,将 200 多个内部应用的流量整合到单一模型上。质量通过按生产流量分层的离线基准进行跟踪,并由确定性验证器或经过校准的 LLM 评判器打分。不同于针对Data-residency constraints force enterprises to self-host LLMs, but continuous adoption of newer models without decommissioning their predecessors expands the serving fleet, fragmenting a finite GPU pool. We consolidate traffic from over 200 internal applications onto a single model by closing quality gaps identified through production error analysis along three axes: instruction following, function-calling, and internal task distribution. Quality is tracked by offline benchmarks stratified to production traffic and scored by deterministic verifiers or calibrated LLM judges. Rather than optimi

Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents
Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents
arXiv:2606.26080 工程化 评测集 OA · 绿色 被引 1 · S2

本文表明强化学习(RL)后训练已具备实现有效 step-level 评分所需的要素,从而完全无需额外的奖励模型训练,并在通用随机 Markov 决策过程下推导出一种隐式 advantage,称为 progress advantage。This work shows that reinforcement learning (RL) post-training already provides the ingredients for effective step-level scoring, eliminating the need for dedicated reward model training altogether, and derives an implicit advantage under a general stochastic Markov decision process, which is term progress advantage.

Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
通过表征锚定与语言-动作对齐的可泛化 VLA 微调
arXiv:2607.13429 工程化 评测集 OA · 绿色 被引 4 · S2

本文提出 Anchor-Align,通过两个目标增强 BC:Vision-Language Anchoring 从冻结 VLM 副本中蒸馏逐层表示以防止该漂移;Language-Action Alignment 将每个动作目标转换为离散的运动方向标签,并在同一机器人观测上联合训练语言与动作预测。Anchor-Align is proposed, which augments BC with two objectives: Vision-Language Anchoring distills layer-wise representations from a frozen VLM copy to prevent this drift, and Language-Action Alignment converts each action target into a discrete motion-direction label and jointly trains language and action prediction on the same robot observation.

DataPrep-Bench: Benchmarking LLMs as Training Data Preparators
DataPrep-Bench: 将 LLM 作为训练数据准备器的基准测试
arXiv:2607.20465 工程化 评测集 OA · 绿色 被引 1 · S2

提出 DataPrep-Bench,首个统一基准,在共享的下游任务 grounding 协议下,对 LLM 驱动的数据准备在六个领域、多种 base model 上的两类能力进行联合评估。DataPrep-Bench is introduced, the first unified benchmark that jointly evaluates both capabilities under a shared downstream-grounded protocol over six domains and multiple base models of LLM-driven data preparation.

Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models
增强并不意味着可预测:思维模型中的推理行为
arXiv:2608.13760 工程化 评测集 OA · 绿色 被引 0 · S2 + OpenAlex

发现面向推理的训练并未优先放大具有最高 Lift 的行为,这促使研究者采用过程级目标,以奖励经过校准且有依据的推理,而不仅仅是表面形式。It is found that reasoning-oriented training does not preferentially amplify the highest-Lift behaviors, motivating process-level objectives that reward calibrated and grounded reasoning rather than surface form alone.