TraceForge: Distilling with Your Own Thinking

One-line takeaway

TraceForge addresses distillation when frontier APIs return only answers or short summaries without reasoning traces: rather than recovering hidden reasoning by replaying encrypted blocks across models, which breaks providers' terms of service, it proposes distilling with reasoning traces generated by your own model.

TraceForge 讨论一些前沿模型只返回答案或简短摘要、不给完整推理过程时，怎样用自己的模型生成推理链来做蒸馏：作者认为靠跨模型重放加密推理块来恢复隐藏推理违反服务条款，不能长期依赖，提出“用自己的思考来蒸馏”的替代路线。