promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
promptfoo scores 7.7/10 (Strong) in Benchmarks & Resources.
Kind Toolkit Language TypeScript License MIT Stars 22.9k★ Repo promptfoo/promptfoo
Quality
Strong 7.7
Adoption 59
Activity 90
Maturity 97
Community 58
Capability 50
Show the math
Overall 7.7/10
value = 7.7/10
score = value
Adoption 6.3/10
value = 59/100
score = 1 + 9 * value / 100
Activity 9.1/10
value = 89.8/100
score = 1 + 9 * value / 100
Maturity 9.7/10
value = 96.9/100
score = 1 + 9 * value / 100
Community 6.2/10
value = 58/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
22.9k★ GitHub stars
1.2k/90d Recent commits
17 devs/90d Recent contributors
3.2y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
evaluation testing red-teaming cli