TrueFoundry AI Gateway is the proxy layer that sits between your applications and the LLM providers and MCP Servers. It is an enterprise-grade platform that enables users to access 1000+ LLMs using a unified interface while taking care of observability and governance.

Key Features

Why Choose TrueFoundry AI Gateway?

Supported Integrations

We integrate with 1000+ LLMs through the following providers.

If you don’t see the provider you need, there is a high change it will just work as self hosted models or OpenAI provider. Please reach out to us at support@truefoundry.com and we will be happy to guide you.

Deployment Options

The Truefoundry AI Gateway can either be used as a SaaS offering or deployed on-premise.

  • SaaS Offering: You can directly use the gateway as a SaaS offering by signing up on our website, you can find the instructions here.
  • Enterprise Deployment for enterprise security and control. You can deploy the gateway in your cloud or on-premise. You can find the architecture and deployment instructions here.

Frequently Asked Questions