Add self hosted model to Gateway

You can also deploy an open-source or private model on TrueFoundry and add it to Gateway directly.

This can also be extended to fine-tuned models and even embedding models. The process to 'Add to Gateway' remains the same.

Refer to our docs on Deploying LLMs From Model Catalog for how to deploy LLMs from our model catalogue in a few clicks.

Once you have your model deployed -

1. Go to the deployments page to locate your deployed model.
2. Click on the deployment to access the deployment details. Then Click on 'Add to LLM Gateway'

3. Enter the model name you want to display in the Gateway and your provider account.

4. The model should appear under the 'TrueFoundry Self-Hosted' section in the Playground.