Inspect AI
Inspect: A framework for large language model evaluations
Inspect AI scores 7/10 (Strong) in Observability & Evals.
Language Python License MIT Stars 2.3k★ Type library Self-host Yes Repo UKGovernmentBEIS/inspect_ai Homepage https://inspect.aisi.org.uk
Quality
Strong 7.0
Adoption 34
Activity 93
Maturity 94
Community 45
Capability 50
Show the math
Overall 7/10
value = 7/10
score = value
Adoption 4.1/10
value = 34/100
score = 1 + 9 * value / 100
Activity 9.3/10
value = 92.7/100
score = 1 + 9 * value / 100
Maturity 9.5/10
value = 94.3/100
score = 1 + 9 * value / 100
Community 5/10
value = 44.5/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
2.3k★ GitHub stars
1.2k/90d Recent commits
24 devs/90d Recent contributors
2.6y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
evals agents safety tool-use llm-as-judge