Model Routing October 9, 2024 updated October 13, 2024 1 min read #routing TLDR send requests to expert or cheaper models, use small routing model to predict which model to send inputs to RouteLLM: An Open-Source Framework for Cost-Effective LLM Routing | LMSYS Org mlrouting