arXiv 2610.06833 · cs.LG · 2026-10-05
Towards Looped Models Done Right, Part II: Rethinking at Fixed Points
Benhao Huang, Chufan Shi, Junlin Chen, Shicheng Wen, Zhengzhong Liu, Eric Xing, Xuezhe Ma
Institute of Foundation Models
在最新榜 #201 本站收录于 2026-10-21
一句话要点
循环语言模型的状态越接近不动点，训练、解码和强化学习都能走捷径，从而大幅省算力。
Driving looped language models towards fixed points enables truncated backprop, KV sharing and cheaper RL with little accuracy loss.
阅读 arXiv 原文 PDF Hugging Face 讨论 代码仓库 项目页
主题与学科
同主题：高效训练与推理
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation ▲511
- Scaling Properties of Same-Family On-Policy Distillation ▲327
- Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation ▲251
- On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics ▲205
- Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation ▲181
数据说明
元数据来自 arXiv API（已核实）；点赞来自 Hugging Face 每日论文；引用来自 Semantic Scholar。最近刷新 2026-10-22。
要点由本站根据摘要自写，不转载摘要原文，请阅读原文。