Negative Self-Distillation: Learning to Reason by Avoiding Flaws

  • 类型:arxiv
  • 标识:2609.11699
  • 链接:https://arxiv.org/abs/2609.11699
  • 主分类:llm-infra
  • 形态:method
  • 被引:3
  • 被引来源:Semantic Scholar
  • S2被引:3
  • OpenAlex被引:0
  • 影响力被引:0
  • TLDR:Negative Self-Distillation (NSD) is introduced, a new framework that optimizes LLMs by diverging from flawed reasoning rather than imitating privileged solutions, and consistently outperforms OPSD and other label-free, self-bootstrapping reinforcement learning (RL) baselines.
  • OpenAlex ID:W7212261691
  • OpenAlex DOI:10.48550/arxiv.2609.11699
  • DOI:10.48550/arxiv.2609.11699
  • DOI来源:OpenAlex
  • 开放获取:green
  • 开放获取链接:https://arxiv.org/pdf/2609.11699
  • OpenAlex更新:2026-09-14
  • 待LLM分类:否
  • 标题中文:负自蒸馏:通过规避缺陷来学习推理
  • TLDR中文:提出 Negative Self-Distillation(NSD),一个通过偏离有缺陷的推理而非模仿特权解来优化 LLM 的新框架,并一致优于 OPSD 及其他无标签、自举式强化学习(RL)基线。
  • 成熟度:research
  • 场景:self-distillation、reasoning
  • 来源文件:
  • /inbox/tom/_candidates/2026-09-11-agent-rag-longcontext-candidates.json
  • [OpenAlex backfill]
  • [S2 enrich]