Indie Alternatives

All › AI › LiteLLM

LiteLLM

Open-source LLM gateway and SDK for 100+ providers

LiteLLM is a Python SDK and proxy server that calls many LLM providers through an OpenAI-style API, with budgets, keys and logging.

Visit LiteLLM ↗

Pricing: Free plan

Platforms: Self-hosted, API

Categories: AI, Developer Tools

LiteLLM compared with similar tools

Product	Price	Open source	Self-host	Platforms
LiteLLM	Free plan	Yes	Yes	Self-hosted, API
vLLM	Free	Yes	Yes	Linux, Self-hosted
LocalAI	Free	Yes	Yes	Self-hosted, Linux, Mac
Helicone	Free plan	Yes	Yes	Web, Self-hosted, API
Dify	Free plan	Yes	Yes	Web, Self-hosted
OpenRouter	Free plan	–	–	API, Web
Ollama	Free plan	–	Yes	Mac, Windows, Linux

Similar to LiteLLM

vLLM

High-throughput LLM inference and serving engine

vLLM is an open-source library for fast LLM serving with PagedAttention, continuous batching and an OpenAI-compatible server.

Free · Linux, Self-hosted · Website ↗

LocalAI

Self-hosted, OpenAI-compatible API for local models

LocalAI is an open-source drop-in replacement for the OpenAI API that runs LLMs, image, audio and embedding models on your hardware.

Free · Self-hosted, Linux, Mac · Website ↗

Helicone

Open-source LLM observability and gateway

Helicone logs and analyzes LLM requests for cost, latency and quality, and offers an AI gateway, self-hostable or managed.

Free plan · Web, Self-hosted, API · Website ↗

Dify

Open-source platform for building LLM apps and agents

Dify provides a visual workflow builder, RAG pipelines, agent tools and model management for building AI applications.

Free plan · Web, Self-hosted · Website ↗

OpenRouter

One API for hundreds of LLMs from many providers

OpenRouter is a unified, OpenAI-compatible API that routes requests to models from many AI providers with fallback and usage tracking.

Free plan · API, Web · Website ↗

Ollama

Run open large language models locally

Ollama downloads and runs open models such as Llama, Gemma, Qwen and Mistral on your computer with a CLI and local API.

Free plan · Mac, Windows, Linux · Website ↗

GlitchTip

Open-source error tracking compatible with Sentry SDKs

GlitchTip collects application errors and performance data using Sentry's open SDKs, and can be self-hosted or used as a hosted service.

Free plan · Web, Self-hosted · Website ↗

Portkey

AI gateway with observability and guardrails

Portkey provides an AI gateway for routing, caching and fallback across LLM providers, plus logging, prompts and guardrails.

Free plan · Web, API, Self-hosted · Website ↗

Questions

Is LiteLLM free?

LiteLLM is free to start, with paid plans.

Is LiteLLM open source?

Yes, LiteLLM is open source.

Can LiteLLM be self-hosted?

Yes, you can run LiteLLM on your own server.

What platforms does LiteLLM run on?

LiteLLM is available for Self-hosted, API.

What are some alternatives to LiteLLM?

Similar indie products include vLLM, LocalAI, Helicone, Dify and 4 more.

Is this your product? Submit an update.