This guide walks you through the steps to add Anthropic models in Google Vertex using the TrueFoundry platform, along with configuring access controls.

​
Adding Anthropic Models

​
1. Navigate to the AI Gateway

  • In the TrueFoundry Dashboard, go to AI Gateway → Models
  • Select Google Vertex as your model provider

​
2. Select or Create a Provider Account

  • Choose an existing Vertex Provider Account, or click Create New to set up a new one
  • This account will be used to access and manage your Anthropic models

​
3. Choose an Anthropic Model

You can add an Anthropic model in one of two ways: 3.1 Select from Available Models Screenshot2025 06 24at5 15 21PM Min Pn 3.2 Add a Model Manually
  1. Click the Add Model button located at the bottom of the list
    While adding models from other Vertex partners like Anthropic, you need to provide the model ID in the <partner>/<vertex-model-id> format. For example, anthropic/claude-3-5-sonnet-v2@20241022.
    Screenshot2025 06 24at4 30 47PM Pn
  2. You can find the Model Id of model in Google Console Screenshot2025 06 24at4 24 26PM Pn

​
4. Configure Model Settings

  • When adding a model manually, you can specify additional settings such as the Region
    The Region is optional. If left blank, it will inherit the default region specified during Provider Account creation. Use this field only if you want to override the default region.