📄️ ML Infrastructure
- GitHub - skypilot-org/skypilot: SkyPilot is a framework for easily running machine learning workloads on any cloud through a unified interface.
📄️ Machine Learning Compilers
TVM
📄️ Model Compression
- DeepSparse
📄️ Mobile Inference and Mobile Models
GitHub - open-mmlab/mmdeploy: OpenMMLab Model Deployment Framework
📄️ Server Inference
Triton-inference-server