vibehacker

LiteLLM

Call 100+ LLMs with one OpenAI-compatible API

by BerriAICoding & Dev ToolsAgents & Automation Listed Jul 1, 2023

Product badge

Share this product's name and rating in your README or on your website.

LiteLLM: rating on VibeHacker

Updates may be delayed by image caching.

LiteLLM cover

About LiteLLM

LiteLLM is a Python library and proxy server that provides a unified OpenAI-compatible interface to 100+ LLM providers.

Use one client for OpenAI, Anthropic, Azure, Bedrock, Groq, Ollama, and many others, with load balancing, spend tracking, and fallbacks.

Highlights

  • Unified API across many providers
  • Proxy with budgets and logging
  • Fallbacks and load balancing
  • Popular glue for agent stacks

Used LiteLLM?

Log in to write a review.

No reviews yet

Used it? Write the first review.

Similar tools

View all