All › AI › Promptfoo

Promptfoo

Test and red-team LLM apps from the command line

Promptfoo is an open-source CLI for evaluating prompts and models with test cases and for red-teaming LLM apps for security issues.

Visit Promptfoo ↗

Pricing: Free plan

Platforms: Mac, Linux, Windows, Web

Categories: AI, Developer Tools

Promptfoo compared with similar tools

Product	Price	Open source	Self-host	Platforms
Promptfoo	Free plan	Yes	–	Mac, Linux, Windows, Web
Aider	Free	Yes	–	Mac, Windows, Linux
Hurl	Free	Yes	–	Mac, Windows, Linux
Mockoon	Free plan	Yes	–	Mac, Windows, Linux
Langfuse	Free plan	Yes	Yes	Web, Self-hosted, API
HTTPie	Free plan	Yes	–	Mac, Windows, Linux, Web
rembg	Free	Yes	Yes	Linux, Mac, Windows, Self-hosted

Similar to Promptfoo

Aider

AI pair programming in your terminal

Aider is an open-source command-line tool that edits code in your Git repo using LLMs and commits the changes.

Free · Mac, Windows, Linux · Website ↗

Hurl

Run and test HTTP requests from plain text files

Hurl is an open-source CLI that runs HTTP requests defined in text files and asserts on responses for API testing.

Free · Mac, Windows, Linux · Website ↗

Mockoon

Create mock REST APIs locally in seconds

Mockoon is an open-source desktop app and CLI for designing and running mock APIs locally, with templating, rules and OpenAPI import.

Free plan · Mac, Windows, Linux · Website ↗

Langfuse

Open-source LLM engineering platform for tracing and evals

Langfuse provides tracing, prompt management, evaluations and datasets for LLM applications, cloud or self-hosted.

Free plan · Web, Self-hosted, API · Website ↗

HTTPie

Human-friendly HTTP client for the terminal and desktop

HTTPie offers a popular open-source command-line HTTP client plus web and desktop apps for testing APIs.

Free plan · Mac, Windows, Linux, Web · Website ↗

rembg

Open-source tool to remove image backgrounds

A Python library and command-line tool that removes backgrounds from images using machine-learning models, runnable locally or as a server.

Free · Linux, Mac, Windows, Self-hosted · Website ↗

Braintrust

Evals, logging and prompt playground for AI products

Braintrust helps teams evaluate AI models and prompts, log production traces, and iterate in a shared playground.

Free plan · Web, API · Website ↗

Portkey

AI gateway with observability and guardrails

Portkey provides an AI gateway for routing, caching and fallback across LLM providers, plus logging, prompts and guardrails.

Free plan · Web, API, Self-hosted · Website ↗

Questions

Is Promptfoo free?

Promptfoo is free to start, with paid plans.

Is Promptfoo open source?

Yes, Promptfoo is open source.

What platforms does Promptfoo run on?

Promptfoo is available for Mac, Linux, Windows, Web.

What are some alternatives to Promptfoo?

Similar indie products include Aider, Hurl, Mockoon, Langfuse and 4 more.

Is this your product? Submit an update.