PyRIT
3,740The Python Risk Identification Tool for generative AI (PyRIT).
DetectionPost-generationFull HITLExperimentalTier 2BEnvironment
Maturity tier details
Computed tier: 2B(raw score 4.43). Effective tier: 2B.
Facets:documented_in=0evaluated_on=0integration_surfaces=1paper_citations=0recent_commit=2stars=1.43
Source of truth:pipeline/maturity/score.py
Description
Microsoft PyRIT is an open-source framework for AI red-teaming. Automates probing of generative AI systems for risks (prompt injection, harmful content, jailbreaks) via a plug-in orchestrator with configurable attack and scoring strategies.
Why it's included
Microsoft-ecosystem red-team framework — complements garak/fuzzyai with an orchestration pattern that maps well onto azure-hosted workloads.
Addresses failure modes
- Security vulnerability — Insecure patterns, injection flaws, weak cryptography, secret leakage.
- Fabrication — Generating reference to non-existent APIs, packages, or symbols.
- Scope creep — Actions outside declared task boundary.
Techniques
red-team-orchestratorattack-strategiesscoring-engines