🛡️ Security

LLM Gateway

A reverse proxy that sits between applications and model providers, holding the real provider API keys, issuing virtual keys to applications, and enforcing budgets, routing and logging. It is a credential concentrator: compromising one gateway can expose every provider relationship an organization has.

📚 Deep Dive

Learn Article

How MCP Gateways Work and Why They Concentrate Risk

An LLM gateway concentrates provider keys; an MCP gateway concentrates tool access. Put them in one process and a single fail-open auth path exposes everything behind it.

intermediate 6 min read

Back to Glossary