About LiteLLM

LiteLLM is a universal LLM API gateway that simplifies LLM API calls by providing a unified OpenAI-compatible interface for 100+ LLM providers. It acts as a proxy that translates requests between different LLM provider APIs, enabling developers to switch between providers without changing their code.

Key Features

• Universal API: OpenAI-compatible interface for all supported LLM providers
• 100+ Providers: Support for OpenAI, Anthropic, Azure, Bedrock, Vertex AI, Cohere, Hugging Face, and many more
• Load Balancing: Built-in load balancing and failover capabilities
• Rate Limiting: Per-user and per-model rate limiting
• Cost Tracking: Usage tracking and budget management
• Caching: Response caching to reduce costs and improve performance
• Authentication: API key management and user authentication
• Monitoring: Comprehensive logging and metrics

Use Cases

• Multi-Provider Strategy: Easily switch between LLM providers
• Cost Optimization: Compare costs across providers and optimize usage
• Reliability: Implement failover and load balancing across multiple providers
• Development: Standardize LLM integration across development teams
• Enterprise: Centralized LLM access control and monitoring

For more details, visit https://docs.litellm.ai/⁠ and https://github.com/BerriAI/litellm⁠.

About Docker Hardened Images

Docker Hardened Images are built to meet the highest security and compliance standards. They provide a trusted foundation for containerized workloads by incorporating security best practices from the start.

Why use Docker Hardened Images?

These images are published with zero-known CVEs, include signed provenance, and come with a complete Software Bill of Materials (SBOM) and VEX metadata. They're designed to secure your software supply chain while fitting seamlessly into existing Docker workflows.

Trademarks

This listing is prepared by Docker. All third-party product names, logos, and trademarks are the property of their respective owners and are used solely for identification. Docker claims no interest in those marks, and no affiliation, sponsorship, or endorsement is implied.