Adding Gemini Models in Google Vertex

This guide walks you through the steps to add Gemini models in Google Vertex using the TrueFoundry platform, along with configuring access controls.

​

Adding Gemini Models

​

1. Navigate to the AI Gateway

• In the TrueFoundry Dashboard, go to AI Gateway → Models
• Select Google Vertex as your model provider

​

2. Select or Create a Provider Account

• Choose an existing Vertex Provider Account, or click Create New to set up a new one
• This account will be used to access and manage your Gemini models

​

3. Choose a Gemini Model

You can add a Gemini model in one of two ways:

3.1 Select from Available Models

3.2 Add a Model Manually

1. Click the Add Model button located at the bottom of the list

   While adding Gemini Models, you can simply provide the model ID in the form. For example, you’d fill gemini-1.5-flash for Gemini 1.5 Flash model.

2. You can find the Model ID of model in Google Console

​

4. Configure Model Settings

• When adding a model manually, you can specify additional settings such as the Region

  The Region is optional. If left blank, it will inherit the default region specified during Provider Account creation. Use this field only if you want to override the default region.