AI Rank

Infrastructure AI Projects

Daily ranking page for Infrastructure open-source AI repositories.

Infrastructure tracks 1634 repositories with 6994577 total GitHub stars.

  1. Niko1221/Strata - Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional... (9097 stars, C++, Infrastructure)
  2. lexmount/moli - Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust (6984 stars, Rust, Infrastructure)
  3. paperclipai/paperclip - The open-source app everyone uses to manage agents at work (96897 stars, TypeScript, Infrastructure)
  4. diegosouzapw/OmniRoute - Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works w... (72801 stars, TypeScript, Infrastructure)
  5. monid-ai/monid - Monid - OpenRouter for agent tools. Join our community at https://discord.gg/rQzztcgJV8 (1696 stars, TypeScript, Infrastructure)
  6. p-e-w/heretic - Fully automatic censorship removal for language models (33146 stars, Python, Infrastructure)
  7. kestra-io/kestra - Event Driven Orchestration & Scheduling Platform for Mission Critical Applications (29090 stars, Java, Infrastructure)
  8. tashfeenahmed/freellmapi - 7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint.... (30493 stars, TypeScript, Infrastructure)
  9. antirez/ds4 - DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm (23257 stars, C, Infrastructure)
  10. ThinkWatchProject/ThinkWatch-Lite - Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from rel... (1018 stars, TypeScript, Infrastructure)
  11. NVIDIA/OpenShell - OpenShell is the safe, private runtime for autonomous AI agents. (14740 stars, Rust, Infrastructure)
  12. FalkorDB/FalkorDB - A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide the best Knowledg... (6851 stars, Rust, Infrastructure)
  13. Alishahryar1/free-claude-code - Use Claude Code, Codex, VSCode, Pi, and OpenCode (and 6 other harnesses) for free (1.3B+ free tokens) from your terminal, app, IDE, or phone, and now fr... (56558 stars, Python, Infrastructure)
  14. router-for-me/CLIProxyAPI - Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjo... (54079 stars, Go, Infrastructure)
  15. herdrdev/herdr - the runtime your coding agents live on (42142 stars, Rust, Infrastructure)
  16. trycua/cua - Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation. (28003 stars, Rust, Infrastructure)
  17. AlexsJones/llmfit - Hundreds of models & providers. One command to find what runs on your hardware. (37576 stars, Rust, Infrastructure)
  18. CopilotKit/OpenBot - Open-source AI coworkers that each get a computer of their own: a browser, files and tools, with every action decided before it happens and recorded aft... (6008 stars, TypeScript, Infrastructure)
  19. agent-substrate/substrate - Agent Substrate: the core system (4253 stars, Go, Infrastructure)
  20. linguo2625469/workbuddy2api-panel - 把腾讯WorkBuddy账号变成 OpenAI 兼容 API 的多账号网关，同时自动完成任务中心全部任务，附 Web 管理面板（账号池可视化 / 积分任务 / 配置热更新）。基于 Sliverkiss/workbuddy2api 的增强分支 (1841 stars, Go, Infrastructure)
  21. ggml-org/llama.cpp - LLM inference in C/C++ (130266 stars, C++, Infrastructure)
  22. ollama/ollama - Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (182158 stars, Go, Infrastructure)
  23. HKUDS/CLI-Anything - "CLI-Anything: Making ALL Software Agent-Native" -- CLI-Hub: https://clianything.cc/ (51493 stars, Python, Infrastructure)
  24. lightpanda-io/browser - Lightpanda: the headless browser designed for AI and automation (35962 stars, Zig, Infrastructure)
  25. tigerless-labs/cost-xray - See what Claude Code and Codex actually send to the API — and what each part costs. (3852 stars, Python, Infrastructure)
  26. slothflowlabs/duckle - Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data q... (1405 stars, Rust, Infrastructure)
  27. vllm-project/vllm - A high-throughput and memory-efficient inference and serving engine for LLMs (93161 stars, Python, Infrastructure)
  28. Wei-Shaw/sub2api - Sub2API 一站式开源中转服务，让 Claude、Openai 、Gemini、Grok订阅统一接入，支持拼车共享，更高效分摊成本，原生工具无缝使用。 (43281 stars, Go, Infrastructure)
  29. lyogavin/airllm - AirLLM 70B inference with single 4GB GPU (35360 stars, Jupyter Notebook, Infrastructure)
  30. h4ckf0r0day/obscura - The headless browser for AI agents and web scraping (28326 stars, Rust, Infrastructure)
  31. decolua/9router - Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RT... (30272 stars, JavaScript, Infrastructure)
  32. lidge-jun/opencodex - Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code (16905 stars, TypeScript, Infrastructure)
  33. google/ax - Google's open agentic orchestration runtime (13026 stars, Go, Infrastructure)
  34. BerriAI/litellm - The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancin... (60116 stars, Python, Infrastructure)
  35. google/artemis - ARTEMIS turns natural-language instructions into reliable Android automation. It automates end-to-end workflows, captures logs, and integrates seamlessl... (10945 stars, Python, Infrastructure)
  36. QuantumNous/new-api - A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-co... (49252 stars, Go, Infrastructure)
  37. facebookresearch/faiss - A library for efficient similarity search and clustering of dense vectors. (41054 stars, C++, Infrastructure)
  38. Jwuthri/Tracely-ai - Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, repl... (1447 stars, Python, Infrastructure)
  39. superradcompany/microsandbox - 🧱 easy, fast, programmable and local-first microVM runtime and library (8555 stars, Rust, Infrastructure)
  40. ascending-llc/jarvis-registry - Connect any AI copilot or autonomous agent to your enterprise tools — through a single, secure MCP/Agent gateway with built-in identity, access control,... (3334 stars, Python, Infrastructure)
  41. xerj-org/xerj - XERJ is the new way for AI to search data. Its autoindex capability activates agents to know your data without the token waste of grep and sed. One comm... (2627 stars, Rust, Infrastructure)
  42. ollaya-dev/ollaya - Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models. (1176 stars, Rust, Infrastructure)
  43. yyjeqhc/webcodex - Give cloud AI agents a real development environment on your own machines. (2140 stars, Rust, Infrastructure)
  44. langfuse/langfuse - 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. (35359 stars, TypeScript, Infrastructure)
  45. syv-ai/HyperQwen - Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quot... (1847 stars, Python, Infrastructure)
  46. FlashML-org/FreeToken - FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. (14152 stars, Python, Infrastructure)
  47. ggml-org/whisper.cpp - Port of OpenAI's Whisper model in C/C++ (54125 stars, C++, Infrastructure)
  48. router-for-me/Cli-Proxy-API-Management-Center - This is a WebUI interface based on CLI-Proxy-API, designed to simplify configuration modifications and runtime status monitoring. (4450 stars, TypeScript, Infrastructure)
  49. boxlite-ai/boxlite - The micro-VM for AI agents — light enough to embed on your laptop, elastic enough to power an agentic cloud. (2386 stars, TypeScript, Infrastructure)
  50. MaxHu-xuan/task-state-guard - Reconcile stuck AI-agent tasks after restarts and timeouts. Preview SQLite changes, close stale delivery states, and never guess success. (696 stars, Python, Infrastructure)
  51. jundot/omlx - LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar (22501 stars, Python, Infrastructure)
  52. comet-ml/opik - Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production... (22370 stars, Python, Infrastructure)
  53. feder-cr/dots - Open-source dots for the web: an AI agent with its own browser, one that does not get blocked. (2590 stars, Python, Infrastructure)
  54. ardeyouxipianyi/workbuddy2api-hub - WorkBuddy 国际国内多账号反代网关，支持 Codex / Claude Code / DSH与标准 OpenAI 客户端。 (601 stars, Python, Infrastructure)
  55. superdesigndev/treg - OpenRouter for agent tools. Join community here: https://discord.gg/6mQYYfFMAn (4105 stars, Python, Infrastructure)
  56. router-for-me/EasyCLIProxyAPI - A desktop GUI for CLIProxyAPI and a tool for automatically configuring popular AI agents. (2682 stars, Rust, Infrastructure)
  57. mikehasa/golive-skill - Take your agent-built product live: hosting, database, domain, email, payments — on your own accounts. Open-source Agent Skill + zero-dependency Node CL... (1209 stars, TypeScript, Infrastructure)
  58. maanHimself/OpenDLSS-NR - A Vulkan reimplementation of NVIDIA's DLSS 5 Neural Rendering network, bit-exact against the original. (814 stars, JavaScript, Infrastructure)
  59. sgl-project/sglang - SGLang is a high-performance serving framework for large language models and multimodal models. (36762 stars, Python, Infrastructure)
  60. mizorewww/laya-mlx - Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API. (6749 stars, Python, Infrastructure)

Open the interactive AI Rank dashboard