Skip to main content
SAICA-KG

Tools

promptfoo

20,465

Test prompts, agents, and RAGs — red-teaming, pentesting, and vulnerability scanning for LLMs.

DetectionPost-generationFull HITLStableTier 2APromptEnvironment
Maturity tier details

Computed tier: 2A(raw score 5.22). Effective tier: 2A.

Facets:documented_in=0evaluated_on=0integration_surfaces=1.5paper_citations=0recent_commit=2stars=1.72

Source of truth:pipeline/maturity/score.py

Description

Promptfoo is a CLI + library for testing, evaluating, and red-teaming LLM applications. Supports side-by-side prompt comparison, LLM-as-judge assertions, adversarial red-team generation, and CI integrations. Used by enterprises to gate LLM deployments on pre-prod evals.

Why it's included

Occupies the CLI-driven prompt-eval + red-team cell. Distinct from deepeval (Pytest-native unit tests) by leaning into YAML configs and shift-left red-teaming.

Addresses failure modes

  • Fabrication — Generating reference to non-existent APIs, packages, or symbols.
  • Security vulnerability — Insecure patterns, injection flaws, weak cryptography, secret leakage.
  • Logic error — Correct API use, incorrect logic.
  • Scope creep — Actions outside declared task boundary.
  • Test manipulation — Agent gaming its own evaluation — editing tests or test harness so failures disappear without fixing the underlying bug.

Techniques

prompt-eval-harnessred-team-attacksllm-as-judgeci-gates

View raw YAML on GitHub →