Skip to content
English

Switch theme

// ∿ New Architectures: SSM & Linear Attention

Mamba-2 (State Space Duality)

Shows SSMs and a class of attention are dual, yielding faster Mamba.

Mamba-2 / 状态空间对偶 2024 Research frontier extended

IN PLAIN WORDS

Introduces state space duality: selective SSMs equal masked matrix multiplications, enabling tensor-core-friendly computation and larger states.

Used in: Hybrid-architecture LLMs

TIMELINE · prerequisites → this → what builds on it

2020 Linear Attent…2023 Mamba (Select…2024 Mamba-2 (State Sp…2024 Gated Delta N…

01Original paper

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Tri Dao, Albert Gu · 2024

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Learn first

Mamba-2 (State Space Duality)

Then you can learn

Mamba (Selectiv…Linear AttentionGated Delta Net… Mamba-2 (State Spac…

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

Reference code

04Where the course teaches it

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)