AI Agent Benchmark Compendium
Compendium of over 50 benchmarks for evaluating AI agents, categorized into Function Calling & Tool Use, General Assistant & Reasoning, Coding & Software Engineering, and Computer Interaction.
AI Agent Benchmark Compendium scores 2.6/10 (Nascent) in Benchmarks & Resources.
Kind Resource License No license (all rights reserved) Stars 168★ Repo philschmid/ai-agent-benchmark-compendium
Quality
Nascent 2.6
Adoption 6
Activity 5
Maturity 58
Community 8
Capability 50
Show the math
Overall 2.6/10
value = 2.6/10
score = value
Adoption 1.5/10
value = 5.7/100
score = 1 + 9 * value / 100
Activity 1.4/10
value = 5/100
score = 1 + 9 * value / 100
Maturity 6.2/10
value = 57.5/100
score = 1 + 9 * value / 100
Community 1.7/10
value = 8.1/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
168★ GitHub stars
0/90d Recent commits
0 devs/90d Recent contributors
9mo Project age
9mo ago Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- New project
New (9mo)
Created within the last year — promising but less battle-tested.
- No license
No OSS license
No recognized open-source license is declared; using it commercially is legally ambiguous.
awesome-list benchmark agents reference