Vision Language Pre Training

GitHub - microsoft/BridgeTower: Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"

GitHub - microsoft/react

https://github.com/salesforce/lavis

https://github.com/uta-smile/TCL

https://github.com/YehLi/xmodaler

https://github.com/sangminwoo/awesome-vision-and-language

Masked Vision and Language Modeling for Multi-modal Representation Learning (2022-08-03)

GitHub - facebookresearch/CiT: Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".

GitHub - guilk/VLC: Research code for "Training Vision-Language Transformers from Captions Alone"

GitHub - OliverRensu/TinyMIM

GitHub - RERV/UniAdapter![[Screen Shot 2023-04-19 at 1.13.36 PM.png]

Contrastive

CLIP

• https://github.com/mlfoundations/open_clip

• GitHub - baaivision/EVA: EVA Series: Vision Foundation Model Fanatics from BAAI

• https://github.com/OpenAI/CLIP

• https://github.com/LAION-AI/CLIP_benchmark

• https://github.com/rom1504/clip-retrieval

• https://github.com/rom1504/laion-prepro

• GitHub - yzhuoning/Awesome-CLIP: Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

• e-CLIP: Large-Scale Vision-Language Representation Learning in E-commerce

• GitHub - facebookresearch/SLIP: Code release for SLIP Self-supervision meets Language-Image Pre-training

• GitHub - facebookresearch/flip: Official Open Source code for "Scaling Language-Image Pre-training via Masking"

• GitHub - facebookresearch/diht: Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training

• GitHub - OliverRensu/DeepMIM

Datasets

• https://github.com/rom1504/laion-prepro
• GitHub - allenai/mmc4: MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.