michal.i/o

Neural Architecture Search for SSM Hybrids

Dec 22, 20241 min read

  • layer skipping

  • gating between different modules

  • sliding window attention

  • full attention

  • sigmoid attention

  • tokenformer

  • SSM variants

  • Conv

Backlinks

  • No backlinks found

Graph View