Add Self-hosted Model to Gateway

You can also deploy an open-source or private model on TrueFoundry and add it to Gateway directly. This can also be extended to fine-tuned models and even embedding models.

Refer to our docs on Deploying LLMs From Model Catalog for how to deploy LLMs from our model catalogue in a few clicks.

Follow these steps once you have your model deployed: