arXiv 2610.19975 · cs.LG · 2026-10-14
LatentLoop: Scaling Looped MoE Models with Asymmetric Compute Allocation
Zefeng He, Yunkai Chai, Xiaoyang Chen, Tong Zhu, Zongliang Wu, Yun Luo, Yafu Li, Yu Cheng
Affiliation unverified
In latest · #197 Added on 2026-10-21
One-line takeaway
LatentLoop finds loop visits in looped MoE play asymmetric roles and allocates compute asymmetrically for better results.
LatentLoop 发现循环 MoE 中两次循环作用不对称，据此非对称分配算力以提升效果。
Read on arXiv PDF Hugging Face discussion Code Project page
Topics & disciplines
More on Efficient training & inference
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation ▲511
- Scaling Properties of Same-Family On-Policy Distillation ▲327
- Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation ▲251
- On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics ▲205
- Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation ▲181
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.