CTranslate2
Fast inference engine for Transformer models
CTranslate2 scores 6.2/10 (Solid) in Inference & Serving.
Language C++ License MIT Stars 4.6k★ Type library Self-host Yes Repo OpenNMT/CTranslate2 Homepage https://opennmt.net/CTranslate2
Quality
Solid 6.2
Adoption 42
Activity 59
Maturity 100
Community 44
Capability 50
Show the math
Overall 6.2/10
value = 6.2/10
score = value
Adoption 4.7/10
value = 41.5/100
score = 1 + 9 * value / 100
Activity 6.3/10
value = 59.3/100
score = 1 + 9 * value / 100
Maturity 10/10
value = 100/100
score = 1 + 9 * value / 100
Community 4.9/10
value = 43.5/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
4.6k★ GitHub stars
21/90d Recent commits
6 devs/90d Recent contributors
6.8y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
cpu quantization transformer fast embedding