Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations

  • 类型:arxiv
  • 标识:2607.13399
  • 链接:https://arxiv.org/abs/2607.13399
  • 主分类:engineering
  • 形态:method
  • 被引:5
  • 被引来源:Semantic Scholar
  • S2被引:5
  • OpenAlex被引:0
  • 影响力被引:0
  • TLDR:A systematic study examining the role, pathologies, and regulations of OPD, clarifying the role of OPD as an exploration catalyst and confirming that well-regulated signal quality, rather than mere teacher scale, governs successful exploration in OPD.
  • OpenAlex ID:W7168964786
  • OpenAlex DOI:10.48550/arxiv.2607.13399
  • DOI:10.48550/arxiv.2607.13399
  • DOI来源:OpenAlex
  • 开放获取:green
  • 开放获取链接:https://doi.org/10.48550/arxiv.2607.13399
  • OpenAlex更新:2026-07-19
  • 待LLM分类:否
  • 标题中文:揭开 On-Policy Distillation 的神秘面纱:作用、病态与调控
  • TLDR中文:本文对 OPD 的作用、病态与调控进行系统研究,厘清 OPD 作为探索催化剂的角色,并证实调控良好的信号质量(而非单纯的教师模型规模)才是 OPD 中成功探索的主导因素。
  • 来源文件
  • /inbox/tom/_candidates/2026-07-17-agent-rag-longcontext-candidates.json
  • [S2 enrich]
  • [OpenAlex backfill]