RBR-0038 / infrastructure
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
- Category
- Infrastructure / Backend
- Maturity
- stable
- Input
- REST API / config
- Output
- Structured data / API response
- Stack
- Python · Docker
- Best for
- litellm — infrastructure component