🧬LiteLLM
Also known as LiteLLM Proxy, LiteLLM SDK, LiteLLM Gateway
A free tool that lets your code call over 100 models in one way.
Think of it like
It is like a travel plug. One plug fits the wall in every country.
Example
Jack's team runs the LiteLLM proxy. Each app gets its own key, and moving to another provider is a change to one model name.
Why it matters
Apps stop being tied to one provider. Trying a new model, or leaving an old one, is a change to settings instead of a rewrite.
Definition
Example code
python
from litellm import completion
response = completion(
model="anthropic/claude-sonnet-5",
messages=[{"role": "user", "content": "Hello, how are you?"}],
)
print(response.choices[0].message.content)Common mistake
Key takeaways
- 1One format. OpenAI style for every model.
- 2Library or proxy. In your code, or shared by a team.
- 3Provider first. anthropic/, openai/ and more.