llm-gateway-system

Blazing fast LLMs API Gateway written in Go ⚡️

Token Bank — the local LLM gateway that sits between your AI agents and every provider. Know where tokens go · Spend less with smart routing to Ollama, Groq, GitHub Models · Earn by sharing idle quota on a community P2P network. One-click onboarding for Cursor, Claude Code, Codex CLI, Gemini CLI — no agent changes. Full trace, seamless model swap

企业级的数字员工容器化管理平台

LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).

Jinguzhou (紧箍咒 [jǐn gū zhòu], Band-tightening Spell): OpenAI-compatible LLM gateway and policy engine for AI agents, tool calling, audit logs, human approval, and MCP or LangChain integrations.

Reference Docker Compose stacks, cloud deploy recipes, and SDK integration samples for the DVARA LLM Gateway

Cost-aware, OpenAI-compatible LLM gateway that routes requests across Ollama, OpenAI, Azure and other providers based on complexity, quality, latency and budget.