Overview
LiteLLM is a proxy or gateway that simplifies connecting to a wide range of AI models from different providers. It presents a unified API, often compatible with OpenAI’s, allowing applications to interact with numerous LLMs through a single integration point.
Role in this knowledge base
Acts as a crucial intermediary, enabling Open WebUI to connect to a diverse array of AI models (like Claude, Gemini, Grok) beyond what it natively supports, by translating requests into the appropriate API formats.
Key facts
- It supports over a hundred different AI models and provides an OpenAI-compatible API endpoint, making integration with tools like Open WebUI seamless.