Mamba

#ssm

• Mamba: The Hard Way

• https://goombalab.github.io/blog/2024/mamba2-part1-model/

• State Space Duality (Mamba-2) Part II - The Theory | Goomba Lab

• State Space Duality (Mamba-2) Part III - The Algorithm | Goomba Lab

• State Space Duality (Mamba-2) Part IV - The Systems | Goomba Lab

• YouTube

• On the Tradeoffs of State Space Models - YouTube

• A Visual Guide to Mamba and State Space Models

Transformer Alternatives (mostly SSMs)

Intro

Mamba

Mamba2

• [2405.21060] Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

• [2406.07887] An Empirical Study of Mamba-based Language Models

• Gated Delta Networks: Improving Mamba2 with Delta Rule | OpenReview

Computer Vision

VMamba

Mamba Vision

MambaOut

• [2405.07992] MambaOut: Do We Really Need Mamba for Vision?

\

VLMs

Speech

Code

Codestral Mamba

• Codestral Mamba | Mistral AI | Frontier AI in your hands