arXiv 2610.28559 · cs.CL · 2026-10-20
Large Flow Language Models
Arnav Chavan, Chanhyuk Lee, Udbhav Bamba, Jaehoon Yoo, Seunghoon Hong, Aditi Raghunathan, Jinwoo Kim
机构待核实
在最新榜 #313 本站收录于 2026-10-24
一句话要点
Lafa 是扩展到 8B 参数的连续流语言模型:块内双向异步流、前缀因果注意力,可以从预训练自回归模型改造来训练,推理时用前缀缓存和块并行解码提速;训练了 0.5B、7B 和 8B 三个规模。
Lafa is a continuous flow language model scaled to 8B parameters: blockwise flow with causal attention on the prefix and bidirectional asynchronous flow within blocks, trained by adapting pretrained autoregressive models and served fast via prefix caching and blockwise parallel decoding, at 0.5B, 7B and 8B scales.
阅读 arXiv 原文 PDF Hugging Face 讨论 代码仓库
主题与学科
同主题:大语言模型
- Jeva: System One Models from First Principles ▲371
- Post-Training Leaves Behavioral Shadows on Unrelated Decisions ▲273
- OmniEdu: Open Foundation Models for Learning and Teaching ▲240
- PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking ▲163
- MemT-1.0: Towards Memory-Native Evolution ▲143
同主题:高效训练与推理
- MJev-Spatial: System One Spatial Intelligence via Native Attention Matching 2026-10-15 · ▲556
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation 2026-09-29 · ▲511
- VideoJev: System One Model for Video Understanding and Interaction 2026-10-13 · ▲375
- LEV: Thinking Fast and Deep with Looped Decision Models 2026-10-14 · ▲337
- Scaling Properties of Same-Family On-Policy Distillation 2026-09-26 · ▲327
数据说明
元数据来自 arXiv API(已核实);点赞来自 Hugging Face 每日论文;引用来自 Semantic Scholar。最近刷新 2026-10-26。
要点由本站根据摘要自写,不转载摘要原文,请阅读原文。