Indie Alternatives

All › AI › vLLM

vLLM

High-throughput LLM inference and serving engine

vLLM is an open-source library for fast LLM serving with PagedAttention, continuous batching and an OpenAI-compatible server.

Pricing: Free

Platforms: Linux, Self-hosted

Categories: AI, Developer Tools

vLLM compared with similar tools

Product	Price	Open source	Self-host	Platforms
vLLM	Free	Yes	Yes	Linux, Self-hosted
LiteLLM	Free plan	Yes	Yes	Self-hosted, API
llama.cpp	Free	Yes	Yes	Mac, Windows, Linux
LocalAI	Free	Yes	Yes	Self-hosted, Linux, Mac
Ollama	Free plan	–	Yes	Mac, Windows, Linux
Open WebUI	Free plan	Yes	Yes	Self-hosted, Web
Dify	Free plan	Yes	Yes	Web, Self-hosted

Similar to vLLM

LiteLLM

Open-source LLM gateway and SDK for 100+ providers

LiteLLM is a Python SDK and proxy server that calls many LLM providers through an OpenAI-style API, with budgets, keys and logging.

Free plan · Self-hosted, API · Website ↗

llama.cpp

LLM inference in C/C++ on everyday hardware

llama.cpp is an open-source C/C++ engine for running LLMs in GGUF format on CPUs and GPUs, with a built-in server.

Free · Mac, Windows, Linux · Website ↗

LocalAI

Self-hosted, OpenAI-compatible API for local models

LocalAI is an open-source drop-in replacement for the OpenAI API that runs LLMs, image, audio and embedding models on your hardware.

Free · Self-hosted, Linux, Mac · Website ↗

Ollama

Run open large language models locally

Ollama downloads and runs open models such as Llama, Gemma, Qwen and Mistral on your computer with a CLI and local API.

Free plan · Mac, Windows, Linux · Website ↗

Open WebUI

Self-hosted chat interface for local and cloud LLMs

Open WebUI is an extensible web UI for Ollama and OpenAI-compatible APIs with RAG, multi-user accounts and tools.

Free plan · Self-hosted, Web · Website ↗

Dify

Open-source platform for building LLM apps and agents

Dify provides a visual workflow builder, RAG pipelines, agent tools and model management for building AI applications.

Free plan · Web, Self-hosted · Website ↗

Flowise

Drag-and-drop builder for AI agents and LLM flows

Flowise is an open-source low-code tool for building LLM workflows, chatbots and agents visually.

Free plan · Web, Self-hosted · Website ↗

Gotify

Self-hosted server for sending and receiving messages

Gotify is a simple open-source server for sending push notifications via a REST API and receiving them in real time through a web UI and Android app.

Free · Self-hosted, Android, Web · Website ↗

Questions

Is vLLM free?

vLLM is free.

Is vLLM open source?

Yes, vLLM is open source.

Can vLLM be self-hosted?

Yes, you can run vLLM on your own server.

What platforms does vLLM run on?

vLLM is available for Linux, Self-hosted.

What are some alternatives to vLLM?

Similar indie products include LiteLLM, llama.cpp, LocalAI, Ollama and 4 more.

Is this your product? Submit an update.