Cola2: Co-Adaptive Hierarchical Language Modeling with Continuous Semantic Compression and Balanced Discrete Generation

One-line takeaway

Cola2 is a hierarchical language-modeling framework that compresses dynamically segmented semantic spans into continuous latents and realizes text with a block-causal masked diffusion decoder, with the encoder and decoder co-adapting.

Cola2 是分层语言生成框架：把文本动态切成语义片段压缩成连续潜变量，再用块因果掩码扩散解码器生成离散文本，并让编码器与解码器协同适配。