LiteLLM

LiteLLM is an open-source Python SDK and API proxy gateway developed by BerriAI to unify interactions across model providers. It translates API requests from over 100 LLM services into standard OpenAI-compatible formats. The proxy server manages API key load balancing, team spend caps, automatic retries, and usage logging across enterprise deployments.

Ecosystem functionServes as an open-source standard for API format translation, load balancing, and enterprise governance across model providers.

Business modelOpen-core enterprise subscription and security features