OpenAI Evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
OpenAI Evals scores 5.8/10 (Solid) in Benchmarks & Resources.
Kind Toolkit Language Python License Custom (see repo) Stars 18.8k★ Repo openai/evals
Quality
Solid 5.8
Adoption 57
Activity 31
Maturity 96
Community 63
Capability 50
Show the math
Overall 5.8/10
value = 5.8/10
score = value
Adoption 6.1/10
value = 56.9/100
score = 1 + 9 * value / 100
Activity 3.8/10
value = 30.6/100
score = 1 + 9 * value / 100
Maturity 9.6/10
value = 95.7/100
score = 1 + 9 * value / 100
Community 6.7/10
value = 62.9/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
18.8k★ GitHub stars
2/90d Recent commits
2 devs/90d Recent contributors
3.4y Project age
3mo ago Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- No license
No OSS license
No recognized open-source license is declared; using it commercially is legally ambiguous.
evaluation benchmark framework llm