promptfoo
20,465Test prompts, agents, and RAGs — red-teaming, pentesting, and vulnerability scanning for LLMs.
DetectionPost-generationFull HITLStableTier 2APromptEnvironment
Maturity tier details
Computed tier: 2A(raw score 5.22). Effective tier: 2A.
Facets:documented_in=0evaluated_on=0integration_surfaces=1.5paper_citations=0recent_commit=2stars=1.72
Source of truth:pipeline/maturity/score.py
Description
Promptfoo is a CLI + library for testing, evaluating, and red-teaming LLM applications. Supports side-by-side prompt comparison, LLM-as-judge assertions, adversarial red-team generation, and CI integrations. Used by enterprises to gate LLM deployments on pre-prod evals.
Why it's included
Occupies the CLI-driven prompt-eval + red-team cell. Distinct from deepeval (Pytest-native unit tests) by leaning into YAML configs and shift-left red-teaming.
Addresses failure modes
- Fabrication — Generating reference to non-existent APIs, packages, or symbols.
- Security vulnerability — Insecure patterns, injection flaws, weak cryptography, secret leakage.
- Logic error — Correct API use, incorrect logic.
- Scope creep — Actions outside declared task boundary.
- Test manipulation — Agent gaming its own evaluation — editing tests or test harness so failures disappear without fixing the underlying bug.
Techniques
prompt-eval-harnessred-team-attacksllm-as-judgeci-gates