Is Next-Chunk Reasoning RL Really Better than SFT? Revisiting Training Strategies under no-CoT Data
- 类型:arxiv
- 标识:2608.23256
- 链接:https://arxiv.org/abs/2608.23256
- 主分类:engineering
- 形态:method
- 被引:1
- 被引来源:Semantic Scholar
- S2被引:1
- OpenAlex被引:0
- 影响力被引:0
- TLDR:Mixed SFT, a single supervised fine-tuning stage that jointly trains on no-CoT and long-CoT data, achieves a clearly higher post-RLVR performance ceiling than next-chunk reasoning RL while requiring over 60 times less training compute.
- OpenAlex ID:W7204205953
- OpenAlex DOI:10.48550/arxiv.2608.23256
- DOI:10.48550/arxiv.2608.23256
- DOI来源:OpenAlex
- 开放获取:green
- 开放获取链接:https://arxiv.org/pdf/2608.23256
- OpenAlex更新:2026-09-01
- 待LLM分类:否
- 标题中文:Next-chunk reasoning RL 真的优于 SFT 吗?——在 no-CoT 数据下重新审视训练策略
- TLDR中文:Mixed SFT 是一种单阶段监督微调,联合在 no-CoT 和 long-CoT 数据上训练,相比 next-chunk reasoning RL 取得了明显更高的 RLVR 后性能上限,同时训练算力开销减少超过 60 倍。
- 来源文件:
- /inbox/tom/_candidates/2026-08-27-agent-rag-longcontext-candidates.json
- [S2 enrich]
- [OpenAlex backfill]