🧬Model Routing
Also known as LLM Routing, LLM Router, Model Router
Sending each request to the model that fits it, cheap or strong.
Think of it like
It is like a school nurse. Small cuts get a plaster, and big hurts go to the doctor.
Example
Lucy's help desk sends password questions to a small model and refund fights to a large one. Her bill drops by more than half, and the answers stay as good.
Why it matters
Most requests in an app are easy. Sending them to a small model cuts cost and wait time, while hard ones still get the best answer.
Definition
Common mistake
Key takeaways
- 1Choose before sending. Each request gets its own pick.
- 2Cheap by default. Big models only when needed.
- 3Check the quality. Test each route on real requests.