Multi-Head Latent Attention (MLA)

• [2405.04434] DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
• multi head latent attention (MLA) · GitHub