AI Rank

Infrastructure AI Projects

Daily ranking page for Infrastructure open-source AI repositories.

Infrastructure tracks 1480 repositories with 6282710 total GitHub stars.

  1. diegosouzapw/OmniRoute - Never stop coding. Free MIT AI gateway: one endpoint, 340 providers (90+ free), 1200+ models — Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works... (51686 stars, TypeScript, Infrastructure)
  2. zenbu-labs/terminal-browser - A browser that runs directly inside your existing terminal (1451 stars, Rust, Infrastructure)
  3. herdrdev/herdr - the runtime your coding agents live on (30925 stars, Rust, Infrastructure)
  4. jundot/omlx - LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar (19977 stars, Python, Infrastructure)
  5. AlexsJones/llmfit - Hundreds of models & providers. One command to find what runs on your hardware. (33169 stars, Rust, Infrastructure)
  6. lidge-jun/opencodex - Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code (11456 stars, TypeScript, Infrastructure)
  7. modular/modular - The Modular Platform (includes MAX & Mojo) (27597 stars, Mojo, Infrastructure)
  8. Alishahryar1/free-claude-code - Use Claude Code, Codex, Pi, and OpenCode for free (1.3B+ free tokens) from your terminal, app, IDE, or phone like OpenClaw (voice supported + ToS friendly) (46198 stars, Python, Infrastructure)
  9. ggml-org/llama.cpp - LLM inference in C/C++ (124825 stars, C++, Infrastructure)
  10. router-for-me/CLIProxyAPI - Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini... (48054 stars, Go, Infrastructure)
  11. lyogavin/airllm - AirLLM 70B inference with single 4GB GPU (31792 stars, Jupyter Notebook, Infrastructure)
  12. rocketride-org/rocketride-server - High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+... (6625 stars, Python, Infrastructure)
  13. Wei-Shaw/sub2api - Sub2API 一站式开源中转服务，让 Claude、Openai 、Gemini、Grok订阅统一接入，支持拼车共享，更高效分摊成本，原生工具无缝使用。 (37793 stars, Go, Infrastructure)
  14. lexmount/moli - Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust (721 stars, Rust, Infrastructure)
  15. QuantumNous/new-api - A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-co... (45705 stars, Go, Infrastructure)
  16. opensandbox-group/OpenSandbox - Secure, Fast, and Extensible Sandbox runtime for AI agents. (14425 stars, Python, Infrastructure)
  17. trycua/cua - Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation. (21690 stars, HTML, Infrastructure)
  18. paperclipai/paperclip - The open-source app everyone uses to manage agents at work (78946 stars, TypeScript, Infrastructure)
  19. Nasiko-Labs/nasiko - Developer Control Plane for your AI Agents (5022 stars, Rust, Infrastructure)
  20. vllm-project/vllm - A high-throughput and memory-efficient inference and serving engine for LLMs (89515 stars, Python, Infrastructure)
  21. decolua/9router - Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RT... (25897 stars, JavaScript, Infrastructure)
  22. AgnesAI-Labs/AgnesAI-Models - Official Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows. (3631 stars, Unknown, Infrastructure)
  23. BerriAI/litellm - The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancin... (56831 stars, Python, Infrastructure)
  24. onecli/onecli - Open-source sandboxed agent harness for teams. Giving every employee a secured personal agent. (3196 stars, TypeScript, Infrastructure)
  25. ollama/ollama - Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (179025 stars, Go, Infrastructure)
  26. tashfeenahmed/freellmapi - OpenAI-compatible proxy that stacks the free tiers of 28 LLM providers (~4B tokens/month) behind one /v1 endpoint — plus any custom OpenAI-compatible en... (18914 stars, TypeScript, Infrastructure)
  27. langfuse/langfuse - 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangCh... (33457 stars, TypeScript, Infrastructure)
  28. superradcompany/microsandbox - 🧱 easy fast local-first microVM runtime and library (7818 stars, Rust, Infrastructure)
  29. sgl-project/sglang - SGLang is a high-performance serving framework for large language models and multimodal models. (32158 stars, Python, Infrastructure)
  30. FareedKhan-dev/kimi-k3-in-c - A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. (6129 stars, C, Infrastructure)
  31. h4ckf0r0day/obscura - The headless browser for AI agents and web scraping (21717 stars, Rust, Infrastructure)
  32. youssofal/MTPLX - 3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter. (1469 stars, Python, Infrastructure)
  33. HKUDS/CLI-Anything - "CLI-Anything: Making ALL Software Agent-Native" -- CLI-Hub: https://clianything.cc/ (47850 stars, Python, Infrastructure)
  34. Anakin-Inc/anakin - Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One comma... (2140 stars, Go, Infrastructure)
  35. steipete/CodexBar - Show usage stats for OpenAI Codex and Claude Code, without having to login. (20367 stars, Swift, Infrastructure)
  36. p-e-w/heretic - Fully automatic censorship removal for language models (27891 stars, Python, Infrastructure)
  37. openobserve/openobserve - Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly p... (21347 stars, TypeScript, Infrastructure)
  38. aws/context-ontology-accelerator - An open-source, ontology-based semantic context accelerator that enables AI agents to make more accurate, consistent, and explainable decisions. (553 stars, Python, Infrastructure)
  39. xerj-org/xerj - XERJ is the new way for AI to search data. Its autoindex capability activates agents to know your data without the token waste of grep and sed. One comm... (1494 stars, Rust, Infrastructure)
  40. lightpanda-io/browser - Lightpanda: the headless browser designed for AI and automation (34144 stars, Zig, Infrastructure)
  41. NVIDIA-NeMo/Switchyard - Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling fle... (1933 stars, Rust, Infrastructure)
  42. alvinunreal/oh-my-opencode-slim - Lean, fine tuned Opencode multi agent suite · Mix any models · Auto delegate tasks (8266 stars, TypeScript, Infrastructure)
  43. unclebob/swarm-forge - A simple tool for coordinating several AI agents. (2523 stars, Clojure, Infrastructure)
  44. drumih/turbo-fieldfare - Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook (6209 stars, Swift, Infrastructure)
  45. huangruiteng/loopx - Long-horizon agent control plane for durable, governed work across Codex, Claude Code, and other harnesses. (4975 stars, Python, Infrastructure)
  46. seakee/CPA-Manager-Plus - A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health. (2726 stars, Go, Infrastructure)
  47. agent-substrate/substrate - Agent Substrate: the core system (1298 stars, Go, Infrastructure)
  48. router-for-me/EasyCLIProxyAPI - A desktop GUI for CLIProxyAPI and a tool for automatically configuring popular AI agents. (1345 stars, Rust, Infrastructure)
  49. maximhq/bifrost - Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead a... (7453 stars, Go, Infrastructure)
  50. basketikun/chatgpt2api - ChatGPT官网接口纯协议的逆向实现，支持GPT-Image-2模型、文本模型，兼容OpenAI接口协议，在线批量生图/编辑图，号池管理，支持可编辑PPT/PSD文件逆向，支持导入CPA、sub2api号池 、支持接入Cherry Studio、New Api 等软件 (5909 stars, Python, Infrastructure)
  51. MiaAI-Lab/DeepSeek-v4-Flash-DSpark-2x-DGX-Spark - DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks (819 stars, Python, Infrastructure)
  52. hao-ai-lab/FastVideo - A unified inference and post-training framework for accelerated video generation. (3982 stars, Python, Infrastructure)
  53. Scottcjn/Rustchain - DePIN for Vintage Hardware — Proof-of-Antiquity blockchain where old machines outmine new ones. AI-powered hardware fingerprinting, 15+ CPU architecture... (658 stars, Python, Infrastructure)
  54. antirez/ds4 - DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm (21585 stars, C, Infrastructure)
  55. ccusage/ccusage - npx ccusage (18059 stars, Rust, Infrastructure)
  56. butterbase-ai/butterbase - Open-source backend-as-a-service. Postgres, auth, storage, functions, AI gateway, MCP. (3175 stars, TypeScript, Infrastructure)
  57. BitMiracle-AI/Dormice - The SQLite of agent sandboxes — self-hosted, E2B-compatible. One machine, sandboxes that live forever, idle costs nothing. (773 stars, TypeScript, Infrastructure)
  58. comet-ml/opik - Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production... (21500 stars, Python, Infrastructure)
  59. future-agi/future-agi - Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gate... (1737 stars, Python, Infrastructure)
  60. qdrant/qdrant - Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://clo... (34086 stars, Rust, Infrastructure)

Open the interactive AI Rank dashboard