All › AI › Ollama

Ollama

Run open large language models locally

Ollama downloads and runs open models such as Llama, Gemma, Qwen and Mistral on your computer with a CLI and local API.

Visit Ollama ↗

Pricing: Free plan

Platforms: Mac, Windows, Linux

Categories: AI, Developer Tools

Ollama is an alternative to

ChatGPT · OpenAI API

Ollama compared with similar tools

Product	Price	Open source	Self-host	Platforms
Ollama	Free plan	–	Yes	Mac, Windows, Linux
LocalAI	Free	Yes	Yes	Self-hosted, Linux, Mac
LiteLLM	Free plan	Yes	Yes	Self-hosted, API
vLLM	Free	Yes	Yes	Linux, Self-hosted
LM Studio	Free plan	–	–	Mac, Windows, Linux
Jan	Free	Yes	–	Mac, Windows, Linux
llama.cpp	Free	Yes	Yes	Mac, Windows, Linux

Similar to Ollama

LocalAI

Self-hosted, OpenAI-compatible API for local models

LocalAI is an open-source drop-in replacement for the OpenAI API that runs LLMs, image, audio and embedding models on your hardware.

Free · Self-hosted, Linux, Mac · Website ↗

LiteLLM

Open-source LLM gateway and SDK for 100+ providers

LiteLLM is a Python SDK and proxy server that calls many LLM providers through an OpenAI-style API, with budgets, keys and logging.

Free plan · Self-hosted, API · Website ↗

vLLM

High-throughput LLM inference and serving engine

vLLM is an open-source library for fast LLM serving with PagedAttention, continuous batching and an OpenAI-compatible server.

Free · Linux, Self-hosted · Website ↗

LM Studio

Desktop app to discover and run local LLMs

LM Studio lets you download open models and chat with them locally, and serves them over an OpenAI-compatible local server.

Free plan · Mac, Windows, Linux · Website ↗

Jan

Open-source ChatGPT alternative that runs offline

Jan is a desktop app for chatting with local open models or connecting to cloud APIs, keeping data on your device.

Free · Mac, Windows, Linux · Website ↗

llama.cpp

LLM inference in C/C++ on everyday hardware

llama.cpp is an open-source C/C++ engine for running LLMs in GGUF format on CPUs and GPUs, with a built-in server.

Free · Mac, Windows, Linux · Website ↗

Open WebUI

Self-hosted chat interface for local and cloud LLMs

Open WebUI is an extensible web UI for Ollama and OpenAI-compatible APIs with RAG, multi-user accounts and tools.

Free plan · Self-hosted, Web · Website ↗

Dify

Open-source platform for building LLM apps and agents

Dify provides a visual workflow builder, RAG pipelines, agent tools and model management for building AI applications.

Free plan · Web, Self-hosted · Website ↗

Questions

Is Ollama free?

Ollama is free to start, with paid plans.

Can Ollama be self-hosted?

Yes, you can run Ollama on your own server.

What platforms does Ollama run on?

Ollama is available for Mac, Windows, Linux.

What are some alternatives to Ollama?

Similar indie products include LocalAI, LiteLLM, vLLM, LM Studio and 4 more.

Is this your product? Submit an update.