Skip to main content

Adding Models

This section explains the steps to add Cloudera models and configure the required access controls.
1

Navigate to Cloudera Models in AI Gateway

From the TrueFoundry dashboard, navigate to AI Gateway > Models and select Cloudera.
Navigating to Cloudera Provider Account in AI Gateway

Navigate to Cloudera Models

2

Add Cloudera Account and Authentication

Give a unique name for the Cloudera account. This will be used to refer to the models later. Provide the authentication details for the gateway to access your Cloudera CDP environment. TrueFoundry supports both CDP Workload Authentication (recommended) and Auth Token based authentication.
Using CDP Workload Authentication (Recommended):CDP Workload Authentication is the recommended approach for production environments as it provides better security and access control. This method generates secure workload tokens using your Access key and private key.Choose CDP Workload Auth Token.
  • Enter your Access Key ID, Private Key, and Workload Name.
Store your Private Key in a Secret Group and reference it using the secret’s Fully Qualified Name (FQN) in the Private Key field. This ensures your private key is securely managed and not exposed in plain text.
Cloudera Account Configuration Form with Access Key ID, Private Key, and Workload Name Fields

CDP Workload Authentication

Using Auth Token:Auth Token is suitable for development and testing environments.
  • Choose Token Auth.
  • Enter your pre-generated Auth Token. You can generate this token using the CDP CLI or from your user profile settings.
Cloudera Account Configuration Form with Auth Token Field

Auth Token Authentication

Finally, enter your Cloudera CDP Base URL.
3

Add Models

Click + Add Model to add a new model configuration. The Model ID is the model name assigned to the model when it is registered to the Cloudera AI Registry. You can find this in the Model Endpoint Details UI.
Cloudera model configuration form in TrueFoundry with display name and model ID fields

Add Cloudera Model in TrueFoundry

Inference

After adding the models, you can perform inference using an OpenAI-compatible API via the Playground or by integrating it with your own application.
Code Snippet and Try in Playgroud Buttons for each model

Infer Model in Playground or Get Code Snippet