Embedding Models

#text-embeddings

Encoder Models

BERT

• GitHub - AnswerDotAI/ModernBERT: Bringing BERT into modernity via both architecture changes and scaling

Contextualized

• [2410.02525] Contextual Document Embeddings

Decoder Models

• #226 NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models - YouTube

• [2405.17428] NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

• Gecko - Versatile Text Embeddings Distilled from Large Language Models