Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation

  • 类型：arxiv
  • 标识：2609.02998
  • 链接：https://arxiv.org/abs/2609.02998
  • 主分类：multimodal
  • 形态：method
  • 被引：6
  • 被引来源：Semantic Scholar
  • S2被引：6
  • OpenAlex被引：0
  • 影响力被引：0
  • TLDR：Teacher-Gated On-Policy Distillation is introduced, built on the principle that teacher reliability should be verified at the prompt level before dense supervision is admitted, and outperforms Vanilla OPD in all six single-domain settings and achieves higher seven-benchmark averages at both scales under multi-domain training.
  • OpenAlex ID：W7208750677
  • OpenAlex DOI：10.48550/arxiv.2609.02998
  • DOI：10.48550/arxiv.2609.02998
  • DOI来源：OpenAlex
  • 开放获取：green
  • 开放获取链接：https://arxiv.org/pdf/2609.02998
  • OpenAlex更新：2026-09-10
  • 待LLM分类：否
  • 标题中文：蒸馏前先验证：用于 On-Policy 蒸馏的 Prompt 级教师门控
  • TLDR中文：本文提出 Teacher-Gated On-Policy Distillation（教师门控的在线策略蒸馏），其核心原则是在引入密集监督前以 prompt 级别验证教师可靠性；在全部六个单领域设定下优于 Vanilla OPD，并在多领域训练下于两种规模上取得更高的七项基准平均成绩。
  • 来源文件：
  • /inbox/tom/_candidates/2026-09-08-agent-rag-longcontext-candidates.json
  • [OpenAlex backfill]
  • [S2 enrich]