Cordy Gateway
One endpoint for configured models
A self-hosted, OpenAI-compatible text gateway with operator and member access, API keys, prepaid billing, routing, and optional observability.
Built for teams running their own AI infrastructure
Configured providers, one API
Route text requests through built-in provider integrations and expose stable public model names to clients.
Smart routing & failover
Use weighted, fastest, or region-aware selection with failover, circuit breakers, and channel cooldown. The documented cheapest strategy has a legacy pricing input.
Cost control built in
Member prepaid balances, per-key quotas, effective-dated metering prices, request cost snapshots, and invoice reconciliation.
Self-hosted control plane
Run the Admin, Gateway, Postgres, and Redis on your infrastructure, with encrypted upstream credentials and offline licensing.
Drop-in OpenAI compatible
Keep the OpenAI SDK and change the base URL and key for text chat, streaming, models, and embeddings.
Operator-grade observability
Request logs, usage and cost views, audit evidence, Prometheus metrics, and optional Tempo or Langfuse tracing.