Luce-Org/lucebox-hub
Daily ranking profile for Luce-Org/lucebox-hub in AI Rank.
Lucebox optimization hub: hand-tuned LLM inference, built for specific consumer hardware.
- Stars: 2048
- Forks: 193
- Language: C++
- Category: Infrastructure
- Subcategory: Kernels,Model optimization
- Keywords: CUDA programming, Inference optimization, LocalAI, Memory management