ggml-org/llama.cpp

Daily ranking profile for ggml-org/llama.cpp in AI Rank.

LLM inference in C/C++

Stars: 110041
Forks: 18181
Language: C++
Category: Infrastructure
Subcategory: Inference service optimization
Keywords: LocalAI

Open the GitHub repository

Open the interactive AI Rank dashboard