AgentBench
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
AgentBench scores 4.4/10 (Emerging) in Benchmarks & Resources.
Kind Resource Language Python License Apache-2.0 Stars 3.5k★ Repo thudm/agentbench
Quality
Emerging 4.4
Adoption 39
Activity 11
Maturity 88
Community 37
Capability 50
Show the math
Overall 4.4/10
value = 4.4/10
score = value
Adoption 4.5/10
value = 38.7/100
score = 1 + 9 * value / 100
Activity 2/10
value = 11/100
score = 1 + 9 * value / 100
Maturity 8.9/10
value = 87.6/100
score = 1 + 9 * value / 100
Community 4.3/10
value = 36.7/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
3.5k★ GitHub stars
0/90d Recent commits
0 devs/90d Recent contributors
2.9y Project age
5mo ago Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
benchmark agents evaluation environments