---
slug: "promptfoo"
name: "Promptfoo"
effect: "Runs evals and red-team scans against prompts, models and agents from a CLI, with a web results viewer"
category: "eval-observability"
url: "https://www.promptfoo.dev"
github: "promptfoo/promptfoo"
pricing: "open-source"
license: "MIT"
tags: ["evals", "red-teaming", "cli", "ci", "security"]
platforms: []
install_kind: "npm"
date_added: "2026-10-14"
drop_score: 61
stars: 25999
pushed_at: "2026-10-15T00:14:30Z"
signals_status: "ok"
signals_fetched_at: "2026-10-15T01:19:03.799Z"
page: "https://agenttooldrop.com/tools/promptfoo"
---

# Promptfoo

Runs evals and red-team scans against prompts, models and agents from a CLI, with a web results viewer

Category: Evals and observability. Pricing: Open source. License: MIT.

## Why you would want it

Promptfoo is a CLI and library that runs automated evaluations of prompts and models, compares providers such as OpenAI, Anthropic, Azure, Bedrock and Ollama side by side, and shows results in a web viewer. It also does red teaming and vulnerability scanning, and can review pull requests for LLM-related security and compliance issues. Evals run locally, it works with any LLM API or programming language, and it plugs into CI/CD.

## Best for

- Regression tests for prompts in CI
- Comparing models side by side
- Red teaming LLM apps before launch

## Use it when

You want repeatable, local eval runs and security scans that can gate changes in CI.

## Skip it if

You need tracing and monitoring of live production traffic; promptfoo is built around evals, red teaming and code scanning rather than observability.

## Editor note

Promptfoo is now part of OpenAI and states it remains open source and MIT licensed.

## Install

Install with npm:

```sh
npm install -g promptfoo
promptfoo init --example getting-started
```

Source: https://github.com/promptfoo/promptfoo#readme

## Live signals

Fetched 2026-10-15T01:19:03.799Z (status: ok).

- Repository: promptfoo/promptfoo
- Stars: 25,999
- Forks: 2,482
- Open issues and PRs: 716
- License (GitHub): MIT
- Last push: 2026-10-15
- Latest release: code-scan-action-0.2.2 (2026-10-08)

## Links

- Website: https://www.promptfoo.dev
- GitHub: https://github.com/promptfoo/promptfoo
- Install instructions verified at: https://github.com/promptfoo/promptfoo#readme
- Source for this entry: https://github.com/promptfoo/promptfoo#readme
- AgentToolDrop page: https://agenttooldrop.com/tools/promptfoo
- Full catalog (JSON): https://agenttooldrop.com/tools.json