🧬LLM Gateway
Also known as AI Gateway, LLM Proxy, Model Gateway
One place that all the AI calls in a firm go through.
Think of it like
Think of it like the front desk in a big building. Every guest signs in there first.
Example
Emma's company has six apps that use AI. All of them call one LiteLLM gateway, so finance can see the full bill and security keeps the keys in one place.
Why it matters
It gives one place to control cost, keys and logs, instead of each app doing it its own way.
Definition
Common mistake
Key takeaways
- 1One way in. For every call.
- 2Keys and limits. Held centrally.
- 3Logs and costs. In one place.