llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
llm-d scores 6.9/10 (Solid) in Inference & Serving.
Language Shell License Apache-2.0 Stars 3.7k★ Type heavyweight Self-host Yes Repo llm-d/llm-d Homepage https://llm-d.ai
Quality
Solid 6.9
Adoption 39
Activity 92
Maturity 83
Community 45
Capability 50
Show the math
Overall 6.9/10
value = 6.9/10
score = value
Adoption 4.5/10
value = 39.2/100
score = 1 + 9 * value / 100
Activity 9.3/10
value = 92.4/100
score = 1 + 9 * value / 100
Maturity 8.5/10
value = 83.2/100
score = 1 + 9 * value / 100
Community 5.1/10
value = 45.2/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
3.7k★ GitHub stars
518/90d Recent commits
45 devs/90d Recent contributors
1.2y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
- Heavyweight
Heavyweight
Resource-heavy to run (GPU, large memory, or multi-service stack).
kubernetes distributed production scaling serving