vLLM Semantic Router
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
vLLM Semantic Router scores 6.8/10 (Solid) in Gateways & Routers.
Language Go License Apache-2.0 Stars 4.8k★ Type service Self-host Yes Repo vllm-project/semantic-router Homepage https://vllm-semantic-router.com
Quality
Solid 6.8
Adoption 42
Activity 86
Maturity 79
Community 47
Capability 50
Show the math
Overall 6.8/10
value = 6.8/10
score = value
Adoption 4.8/10
value = 42/100
score = 1 + 9 * value / 100
Activity 8.8/10
value = 86.2/100
score = 1 + 9 * value / 100
Maturity 8.1/10
value = 78.8/100
score = 1 + 9 * value / 100
Community 5.3/10
value = 47.4/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
4.8k★ GitHub stars
381/90d Recent commits
21 devs/90d Recent contributors
10mo Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- New project
New (10mo)
Created within the last year — promising but less battle-tested.
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
- Managed option
Managed option
Available as a hosted/managed service in addition to self-hosting.
router semantic vllm mixture-of-models kubernetes