Overview

Adding Models

To add Bedrock model to Gateway:

1. From TrueFoundry dashboard, go to Integrations > Add Provider Integration and choose Azure
2. Click on Add Integration and choose Azure OpenAI Model to add an Azure OpenAI model.
3. Fill in the information including the API Key

Supported Models

Azure OpenAI integration supports all kinds of OpenAI models. To start using OpenAI models through Azure:

1. Deploy Azure OpenAI resource and deploy a model. The instructions are available here.
2. Once deployed, the model names can be found in the Deployments tab under Azure OpenAI Service in Azure AI Foundry. You can use the name from this list as Model ID on while filling TrueFoundry Integrations form.