Masked Image Modeling
Masked Auto Encoder (MAE)
Contrastive - Joint Embedding
JEPA - Joint-Embedding Predictive Architecture
- GitHub - facebookresearch/ijepa: Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, “Self-supervised learning from images with a joint-embedding predictive architecture.”
- GitHub - facebookresearch/jepa: PyTorch code and models for V-JEPA self-supervised learning from video.
- [2403.00504] Learning and Leveraging World Models in Visual Representation Learning
Patterns
MAE vs Joint Embedding
