LLMs (Large Language Models)

#ml/nlp/llm

• LLM Worksheet - Google Sheets

• GitHub - lm-sys/FastChat: The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"

• GitHub - kernelmachine/cbtm: Code repository for the c-BTM paper

Tokenization

• GitHub - SumanthRH/tokenization: A comprehensive deep dive into the world of tokens
• GitHub - openai/tiktoken: tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Chat

• GitHub - imoneoi/openchat: OpenChat: Advancing Open-source Language Models with Imperfect Data
• LangChain

Alignment

Instruction Tuning

• GitHub - huggingface/alignment-handbook: Robust recipes for to align language models with human and AI preferences
• GitHub - allenai/open-instruct

RLHF

• Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

• Illustrating Reinforcement Learning from Human Feedback (RLHF)

• [29 Nov 2023] RLHF Lecture @ Stanford - Google Slides

DPO

• [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Model

• RLHF progress: Scaling DPO to 70B, DPO vs PPO update, Tülu 2, Zephyr-β, meaningful evaluation, data contamination

• Fine-tune a Mistral-7b model with DPO.ipynb

• GitHub - eric-mitchell/direct-preference-optimization: Reference implementation for DPO (Direct Preference Optimization)

• Fine-tune Llama 2 with DPO

• RLHF and DPO compared: user feedback methods for LLM optimization | by Automata | 𝐀𝐈 𝐦𝐨𝐧𝐤𝐬.𝐢𝐨 | Oct, 2023 | Medium

Training

• The Novice's LLM Training Guide

• [2310.18313] FP8-LM: Training FP8 Large Language Models

Fine Tuning

• GitHub - OpenAccess-AI-Collective/axolotl: Go ahead and axolotl questions

Inference

Serving

• Hamel’s Blog - Optimizing latency

Quantization

• GitHub - PanQiWei/AutoGPTQ: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
• GitHub - IST-DASLab/gptq: Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

Tutorials

• GitHub - RahulSChand/llama2.c-for-dummies: Step by step explanation/tutorial of llama2.c

Visualization

• LLM Visualization

Decoding

• X

Inference Benchmarks

• Performance of llama.cpp on Apple Silicon · ggerganov/llama.cpp · Discussion #4167 · GitHub

Evaluation

Evaluate LLMs and RAG a practical example using Langchain and Hugging Face

Applications

Text to SQL

• GitHub - defog-ai/sqlcoder: SoTA LLM for converting natural language questions to SQL queries