Adding Anthropic Models in Google Vertex

This guide walks you through the steps to add Anthropic models in Google Vertex using the TrueFoundry platform, along with configuring access controls.

​

Adding Anthropic Models

​

1. Navigate to the AI Gateway

• In the TrueFoundry Dashboard, go to AI Gateway → Models
• Select Google Vertex as your model provider

​

2. Select or Create a Provider Account

• Choose an existing Vertex Provider Account, or click Create New to set up a new one
• This account will be used to access and manage your Anthropic models

​

3. Choose an Anthropic Model

You can add an Anthropic model in one of two ways:

3.1 Select from Available Models

3.2 Add a Model Manually

1. Click the Add Model button located at the bottom of the list

   While adding models from other Vertex partners like Anthropic, you need to provide the model ID in the <partner>/<vertex-model-id> format. For example, anthropic/claude-3-5-sonnet-v2@20241022.

2. You can find the Model Id of model in Google Console

​

4. Configure Model Settings

• When adding a model manually, you can specify additional settings such as the Region

  The Region is optional. If left blank, it will inherit the default region specified during Provider Account creation. Use this field only if you want to override the default region.