Natural Language Processing

Large Language Models

GitHub - karpathy/nanoGPT: The simplest, fastest repository for training/finetuning medium-sized GPTs.

RL for NLP

GitHub - lvwerra/trl: Train transformer language models with reinforcement learning.

Multi Task

Fine-tune FLAN-T5 for chat & dialogue summarization

Retrieval Augmented

• GitHub - facebookresearch/atlas: Code repository for supporting the paper “Atlas Few-shot Learning with Retrieval Augmented Language Models”,(https//arxiv.org/abs/2208.03299)
• GitHub - stanfordnlp/dsp: The Demonstrate-Search-Predict Framework: Composing retrieval and language models for knowledge-intensive NLP