Cordy Gateway
One endpoint for every model
A self-hostable, OpenAI-compatible gateway that puts one authenticated, metered, cost-controlled endpoint in front of 100+ providers — with routing, failover, and a full admin control plane.
Built for teams running their own AI infrastructure
100+ providers, one API
OpenAI, Anthropic, Gemini, Bedrock, OpenRouter, vLLM and more via LiteLLM, plus a direct OpenAI-compatible fast path.
Smart routing & failover
Per-request weighted, cheapest, fastest, or region-aware routing, with circuit breakers and channel cooldown.
Cost control built in
Prepaid credit ledger, effective-dated pricing, per-request cost snapshots, and a 402 before you ever overspend.
Self-hosted & private
Your keys, your Postgres, your data. No payload capture by default; air-gapped install with offline licensing.
Drop-in OpenAI compatible
Keep the OpenAI SDK — just change the base URL and key. Streaming, tools, and embeddings all work unchanged.
Operator-grade observability
Prometheus + Grafana dashboards, audit log, RBAC, and horizontal scale behind nginx with a single flag.