LiteLLM Documentation
Docs for LiteLLM, an open source LLM gateway that puts over a hundred model providers behind one OpenAI-compatible API. Run it as a Python library or as a proxy server any language can call, and get model routing, fallbacks, retries, per-key budgets, rate limits, caching and cost tracking in one place. The practical way to learn what an LLM gateway does before you build or buy one.
Tool
AI & Machine Learning
BerriAI
Intermediate
Free
Docs for LiteLLM, an open source LLM gateway that puts over a hundred model providers behind one OpenAI-compatible API. Run it as a Python library or as a proxy server any language can call, and get model routing, fallbacks, retries, per-key budgets, rate limits, caching and cost tracking in one place. The practical way to learn what an LLM gateway does before you build or buy one.
Ready to start?
Opens on BerriAI in a new tab.
Stuck on something specific?
Writing only gets you so far. If you want an answer to your situation rather than the general case, book a session and we will work through it together. Sessions are free for approved Sefism members, and a few slots open each week.
Follow along
New writing, resources and project ideas land here first.