2024-11-03 - GATED DELTA NETWORKS IMPROVING MAMBA2 WITH DELTA RULE

• [2412.06464] Gated Delta Networks: Improving Mamba2 with Delta Rule
• gating mechanism
• delta update rule