Deploying NVIDIA NIM Models

​

Adding nvcr.io Docker Registry

1. Generate an API Key from https://org.ngc.nvidia.com/setup/api-keys

   Make sure to give it access to NGC Catalog

2. Add a Custom Docker Registry to the Platform

   Registry URL: nvcr.io Username: $oauthtoken Password: The API Key from the previous step

​

Adding NGC API Key to Secrets

1. Add the same API Key as a Secret on the Platform

​

Deploying a NIM Model

1. From New Deployment page, select NVIDIA NIM.

   • Select the workspace you want to deploy to
   • Select the NVCR Model Registry Integration we created in the previous step
   • Select the NGC API Key Secret we created in the previous step
   • Select the model you want to deploy

2. Click Next and follow the rest of the steps to deploy the model.