TrueFoundry Examples

Welcome to the TrueFoundry Examples page! Here, we provide you with a collection of practical examples to help you get started with various features and capabilities of TrueFoundry. Each example is designed to guide you through the process, from initial setup to deployment, enabling you to harness the full potential of TrueFoundry's platform.

Example 1: Deploying a Machine Learning Service and Configuring Auto-scaling

In this example, we will walk you through the process of deploying a machine learning service using TrueFoundry's Service feature. You'll learn how to initiate a deployment, configure options like auto-scaling to ensure your service can scale based on demand, and explore rollouts to enable a controlled and smooth deployment process. By the end of this example, you'll have a deep understanding of how to effectively manage and deploy your machine learning services.

Key Steps:

1. Initiate a service deployment of your machine learning service.
2. Configure auto-scaling to allow your service to dynamically adjust to demand.
3. Implement rollouts to ensure a controlled deployment process.

Link to Example Code: Deploying a Machine Learning Service with Auto-scaling and Rollouts

Example 2: Training a Machine Learning Model as a Job with Hyperparameters Configuration

In this example, we will walk you through the process of deploying a machine learning job using TrueFoundry's Jobs feature. Not only will you learn how to effectively train a model, but you will also discover how to configure the Params feature to rapidly experiment with various different hyper parameters.

Key Steps:

1. Initiate a job deployment to train a machine learning model.
2. Configure Params for dynamic hyperparameter experimentation.

Link to Example Code: Job with Parameters

Example 3: Fine-tuning a LLM Model.

This example delves into the process of fine-tuning a LLM model using custom data. We will guide you through adapting the model to your specific requirements via fine-tuning your model through the Model Catalogue feature in TrueFoundry.

Key Steps:

1. Perform fine-tuning a LLM model using custom data.

Link to Example Code: Finetuning LLM

Example 4: Deploying a Hugging Face Model as a Model Deployment

This example shows how to deploy a Hugging Face model as a Model Deployment using the TrueFoundry Model Registry feature.

Key Steps:

1. Select and Deploy the Hugging Face model you want to deploy via Model Registry

Link to Example Code: Huggingface Model Deployment

Example 5: Deploying the Docs QA Playground using TrueFoundry

This example demonstrates how to deploy the Docs QA Playground, a powerful system designed for question-answering tasks, using TrueFoundry.
Once the deployment is complete, you can use the Docs QA Playground to answer questions about your documentation.

Key Steps:

1. Deploy the Different Components of Docs QA Playground using TrueFoundry.
2. Access the Docs QA Playground at the specified endpoint.

Link to Example Code: Docs QA

Stay Tuned!

We're continuously adding new examples to our collection to help you explore and make the most of TrueFoundry's capabilities. Be sure to check back here regularly for updates and new examples that will guide you on your journey to successful deployments and advanced workflows with TrueFoundry.