Intro
Links
Articles
Transformer Walkthrough: A walkthrough of transformer architecture code (2022 - Riedl)
https://github.com/cmhungsteve/Awesome-Transformer-Attention
Lectures
Code
- xformers: Hackable and optimized Transformers building blocks, supporting a composable construction.
- GitHub - lucidrains/x-transformers: A simple but complete full-attention transformer with a set of promising experimental features from various papers
- GitHub - explosion/curated-transformers: 🤖 A PyTorch library of curated Transformer models and their composable components