LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
LightLLM scores 6.3/10 (Solid) in Inference & Serving.
Language Python License Apache-2.0 Stars 4.2k★ Type service Self-host Yes Repo ModelTC/LightLLM Homepage https://github.com/ModelTC/LightLLM
Quality
Solid 6.3
Adoption 41
Activity 68
Maturity 96
Community 39
Capability 50
Show the math
Overall 6.3/10
value = 6.3/10
score = value
Adoption 4.6/10
value = 40.5/100
score = 1 + 9 * value / 100
Activity 7.1/10
value = 67.6/100
score = 1 + 9 * value / 100
Maturity 9.6/10
value = 95.8/100
score = 1 + 9 * value / 100
Community 4.5/10
value = 39.3/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
4.2k★ GitHub stars
68/90d Recent commits
8 devs/90d Recent contributors
3y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
- Managed option
Managed option
Available as a hosted/managed service in addition to self-hosting.
serving lightweight throughput python router