LiteLLM

One interface to 100+ LLMs; routing, caching, budgets. Not an agent framework—the pipe every agent framework uses.

provider-agnosticpython

Stars: 62.5k
Adoption surface: mostly simple
Autonomy: n/a
Recovery: retry
License: ✅ open-source
Category: Libraries and SDKs

Repository ↗ Example: Anthropic Agent SDK gateway ↗

Related in Libraries and SDKs

Composio
deepagents
smolagents
vercel/ai
pydantic-ai
E2B

Maintain LiteLLM? Add the badge

Paste this into your README so readers can find the list and see how LiteLLM compares:

[![Best of Agent Harnesses](https://img.shields.io/badge/%F0%9F%8F%86_Best_of-Agent_Harnesses-5ac4bf)](https://github.com/RyanAlberts/best-of-Agent-Harnesses)