arXiv 2609.38169 · cs.CL · 2026-09-29
STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization
Bingchen Yao, Haobo Xu, Haokun Lin, Yichen Wu, Ziyu Guo, Renrui Zhang, Zhichao Lu, Zhenan Sun and 1 more
Zhejiang University
In latest · #73 2026-W41 #10 Added on 2026-10-21
One-line takeaway
STEPQuant studies where and when quantisation errors matter in linear-attention recurrent states, enabling low-precision state storage.
STEPQuant 分析线性注意力循环状态量化误差在时间和空间上的影响，实现低精度状态存储。
Read on arXiv PDF Hugging Face discussion Code
Topics & disciplines
More on Efficient training & inference
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation ▲511
- Scaling Properties of Same-Family On-Policy Distillation ▲327
- Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation ▲251
- On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics ▲205
- Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation ▲181
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.