OptiLLM
Optimizing inference proxy for LLMs
OptiLLM scores 5.7/10 (Solid) in Gateways & Routers.
Language Python License Apache-2.0 Stars 4.2k★ Type service Self-host Yes Repo codelion/optillm Homepage https://github.com/codelion/optillm
Quality
Solid 5.7
Adoption 41
Activity 49
Maturity 90
Community 40
Capability 50
Show the math
Overall 5.7/10
value = 5.7/10
score = value
Adoption 4.6/10
value = 40.5/100
score = 1 + 9 * value / 100
Activity 5.4/10
value = 49.1/100
score = 1 + 9 * value / 100
Maturity 9.1/10
value = 89.5/100
score = 1 + 9 * value / 100
Community 4.6/10
value = 40.2/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
4.2k★ GitHub stars
7/90d Recent commits
3 devs/90d Recent contributors
1.9y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
- Managed option
Managed option
Available as a hosted/managed service in addition to self-hosting.
proxy optimization reasoning openai-compatible inference