We integrate with 1000+ LLMs through the following providers. If you don’t see the provider you need, please reach out to us at support@truefoundry.com and we will be happy to add it. Below is a comprehensive list of popular LLM providers that are supported by TrueFoundry AI Gateway.

Google Vertex AI logoGemini & Vertex AI

AWS Bedrock logoAWS Bedrock

Azure OpenAI logoAzure OpenAI

Azure AI Foundry LogoAzure AI Foundry

OpenAI LogoOpenAI

Cohere

Databricks LogoDatabricks

AI21

Anthropic LogoAnthropic

Together AI

DeepInfra

Ollama

Palm

Perplexity AI

Mistral AI

Groq

Nomic

Self Hosted Models