Mamba

ssm

• https://goombalab.github.io/blog/2024/mamba2-part1-model/
• State Space Duality (Mamba-2) Part II - The Theory | Goomba Lab
• State Space Duality (Mamba-2) Part III - The Algorithm | Goomba Lab
• State Space Duality (Mamba-2) Part IV - The Systems | Goomba Lab
• YouTube
• On the Tradeoffs of State Space Models - YouTube

Intro

Mamba

Mamba2

• [2405.21060] Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

• [2406.07887] An Empirical Study of Mamba-based Language Models

• Gated Delta Networks: Improving Mamba2 with Delta Rule | OpenReview

Computer Vision

VMamba

Mamba Vision

MambaOut

• [2405.07992] MambaOut: Do We Really Need Mamba for Vision?

\

VLMs

Speech

Code

Codestral Mamba

• Codestral Mamba | Mistral AI | Frontier AI in your hands