KoboldCpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
KoboldCpp scores 7.6/10 (Strong) in Inference & Serving.
Language C++ License AGPL-3.0 Stars 10.9k★ Type lightweight Self-host Yes Repo LostRuins/koboldcpp Homepage https://github.com/LostRuins/koboldcpp
Quality
Strong 7.6
Adoption 51
Activity 96
Maturity 97
Community 48
Capability 50
Show the math
Overall 7.6/10
value = 7.6/10
score = value
Adoption 5.6/10
value = 51/100
score = 1 + 9 * value / 100
Activity 9.7/10
value = 96.2/100
score = 1 + 9 * value / 100
Maturity 9.8/10
value = 97.4/100
score = 1 + 9 * value / 100
Community 5.3/10
value = 47.9/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
10.9k★ GitHub stars
1.6k/90d Recent commits
43 devs/90d Recent contributors
3.3y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Copyleft
AGPL-3.0
GPL/AGPL-class license — derivative or networked use may require you to open-source your own code.
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
gguf local single-binary api multimodal