lm-evaluation-harness
A framework for few-shot evaluation of language models.
lm-evaluation-harness scores 7/10 (Strong) in Benchmarks & Resources.
Kind Toolkit Language Python License MIT Stars 13.2k★ Repo eleutherai/lm-evaluation-harness
Quality
Strong 7.0
Adoption 53
Activity 69
Maturity 100
Community 63
Capability 50
Show the math
Overall 7/10
value = 7/10
score = value
Adoption 5.8/10
value = 53/100
score = 1 + 9 * value / 100
Activity 7.2/10
value = 69.3/100
score = 1 + 9 * value / 100
Maturity 10/10
value = 100/100
score = 1 + 9 * value / 100
Community 6.7/10
value = 63.4/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
13.2k★ GitHub stars
51/90d Recent commits
29 devs/90d Recent contributors
5.8y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
evaluation benchmark framework llm