DeepEval
The LLM Evaluation Framework
DeepEval scores 7.5/10 (Strong) in Observability & Evals.
Language Python License Apache-2.0 Stars 16.6k★ Type library Self-host Yes Repo confident-ai/deepeval Homepage https://deepeval.com
Quality
Strong 7.5
Adoption 56
Activity 87
Maturity 96
Community 56
Capability 50
Show the math
Overall 7.5/10
value = 7.5/10
score = value
Adoption 6/10
value = 55.5/100
score = 1 + 9 * value / 100
Activity 8.8/10
value = 87.1/100
score = 1 + 9 * value / 100
Maturity 9.6/10
value = 95.6/100
score = 1 + 9 * value / 100
Community 6/10
value = 55.6/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
16.6k★ GitHub stars
601/90d Recent commits
18 devs/90d Recent contributors
2.9y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
evals testing metrics llm-as-judge ci