Indie Alternatives

All › AI › LocalAI

LocalAI

Self-hosted, OpenAI-compatible API for local models

LocalAI is an open-source drop-in replacement for the OpenAI API that runs LLMs, image, audio and embedding models on your hardware.

Visit LocalAI ↗

Pricing: Free

Platforms: Self-hosted, Linux, Mac

Categories: AI, Self-Hosted

LocalAI is an alternative to

LocalAI compared with similar tools

Product	Price	Open source	Self-host	Platforms
LocalAI	Free	Yes	Yes	Self-hosted, Linux, Mac
Ollama	Free plan	–	Yes	Mac, Windows, Linux
LiteLLM	Free plan	Yes	Yes	Self-hosted, API
Open WebUI	Free plan	Yes	Yes	Self-hosted, Web
vLLM	Free	Yes	Yes	Linux, Self-hosted
llama.cpp	Free	Yes	Yes	Mac, Windows, Linux
AnythingLLM	Free plan	Yes	Yes	Mac, Windows, Linux, Self-hosted

Similar to LocalAI

Ollama

Run open large language models locally

Ollama downloads and runs open models such as Llama, Gemma, Qwen and Mistral on your computer with a CLI and local API.

Free plan · Mac, Windows, Linux · Website ↗

LiteLLM

Open-source LLM gateway and SDK for 100+ providers

LiteLLM is a Python SDK and proxy server that calls many LLM providers through an OpenAI-style API, with budgets, keys and logging.

Free plan · Self-hosted, API · Website ↗

Open WebUI

Self-hosted chat interface for local and cloud LLMs

Open WebUI is an extensible web UI for Ollama and OpenAI-compatible APIs with RAG, multi-user accounts and tools.

Free plan · Self-hosted, Web · Website ↗

vLLM

High-throughput LLM inference and serving engine

vLLM is an open-source library for fast LLM serving with PagedAttention, continuous batching and an OpenAI-compatible server.

Free · Linux, Self-hosted · Website ↗

llama.cpp

LLM inference in C/C++ on everyday hardware

llama.cpp is an open-source C/C++ engine for running LLMs in GGUF format on CPUs and GPUs, with a built-in server.

Free · Mac, Windows, Linux · Website ↗

AnythingLLM

All-in-one AI app for chatting with your documents

AnythingLLM is a desktop and self-hosted app for RAG over documents, AI agents and multi-user chat with local or cloud models.

Free plan · Mac, Windows, Linux, Self-hosted · Website ↗

Dify

Open-source platform for building LLM apps and agents

Dify provides a visual workflow builder, RAG pipelines, agent tools and model management for building AI applications.

Free plan · Web, Self-hosted · Website ↗

Soketi

Open-source WebSocket server compatible with Pusher

Soketi is a self-hostable WebSocket server that implements the Pusher protocol so existing Pusher clients work with it.

Free · Self-hosted · Website ↗

Questions

Is LocalAI free?

LocalAI is free.

Is LocalAI open source?

Yes, LocalAI is open source.

Can LocalAI be self-hosted?

Yes, you can run LocalAI on your own server.

What platforms does LocalAI run on?

LocalAI is available for Self-hosted, Linux, Mac.

What are some alternatives to LocalAI?

Similar indie products include Ollama, LiteLLM, Open WebUI, vLLM and 4 more.

Is this your product? Submit an update.