mostlygeek/llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

• Stars: 4032
• Forks: 310
• Language: Go
• Category: Infrastructure
• Subcategory: Deploy & Serve,Gateway
• Keywords: LocalAI

Open the GitHub repository

Open the interactive AI Rank dashboard