Flowise is an open-source LLM application builder that enables users to create LLM applications using drag-and-drop tools. TrueFoundry integrates seamlessly with Flowise, allowing you to deploy your Flowise applications through TrueFoundry’s Gateway.

TrueFoundry’s AI Gateway provides comprehensive integration with Flowise, routing all LLM calls through the Gateway to ensure your applications are secure, compliant, and cost-effective through the Gateway’s built-in features.

Prerequisites

Before integrating Flowise with TrueFoundry, ensure you have the following:

  1. Authentication Token: Create a Personal Access Token or Virtual Account in TrueFoundry by following the instructions in Generating Tokens. This token will authenticate your Flowise application to the TrueFoundry Gateway.

  2. Gateway Base URL: Locate your TrueFoundry Gateway base URL, which follows the format <control plane url>/api/llm. The control plane URL is where your TrueFoundry dashboard is hosted (e.g., https://company.truefoundry.cloud/api/llm).

  3. Flowise Account: Set up a Flowise account using either the open-source version for local deployment or the SaaS version.

Configuration Steps

This guide assumes you have an active Flowise account and have obtained your TrueFoundry AI Gateway base URL and authentication token.

Step 1: Configure Flowise Credentials

Add your TrueFoundry credentials to Flowise:

Flowise Credentials

Select “OpenAI Custom” from the dropdown menu:

OpenAI Custom

Enter your TrueFoundry token as the credential.

Step 2: Create an Agent

  1. In the left sidebar, select “AgentFlow” and click “Add Node”:

AgentFlow

Add Node

  1. Ensure you create a connection from the Start node to your AgentFlow node.

Edit Node

  1. Retrieve the model ID from the TrueFoundry Dashboard using the copy button:

Get Model ID

Edit Node

Step 3: Save and Test

Click the “Save” button in the top-right corner, then open the chat interface to test your agent:

Save and Test the Agent

Your Flowise application is now integrated with TrueFoundry’s AI Gateway and ready for use.

Flowise is an open-source LLM application builder that enables users to create LLM applications using drag-and-drop tools. TrueFoundry integrates seamlessly with Flowise, allowing you to deploy your Flowise applications through TrueFoundry’s Gateway.

TrueFoundry’s AI Gateway provides comprehensive integration with Flowise, routing all LLM calls through the Gateway to ensure your applications are secure, compliant, and cost-effective through the Gateway’s built-in features.

Prerequisites

Before integrating Flowise with TrueFoundry, ensure you have the following:

  1. Authentication Token: Create a Personal Access Token or Virtual Account in TrueFoundry by following the instructions in Generating Tokens. This token will authenticate your Flowise application to the TrueFoundry Gateway.

  2. Gateway Base URL: Locate your TrueFoundry Gateway base URL, which follows the format <control plane url>/api/llm. The control plane URL is where your TrueFoundry dashboard is hosted (e.g., https://company.truefoundry.cloud/api/llm).

  3. Flowise Account: Set up a Flowise account using either the open-source version for local deployment or the SaaS version.

Configuration Steps

This guide assumes you have an active Flowise account and have obtained your TrueFoundry AI Gateway base URL and authentication token.

Step 1: Configure Flowise Credentials

Add your TrueFoundry credentials to Flowise:

Flowise Credentials

Select “OpenAI Custom” from the dropdown menu:

OpenAI Custom

Enter your TrueFoundry token as the credential.

Step 2: Create an Agent

  1. In the left sidebar, select “AgentFlow” and click “Add Node”:

AgentFlow

Add Node

  1. Ensure you create a connection from the Start node to your AgentFlow node.

Edit Node

  1. Retrieve the model ID from the TrueFoundry Dashboard using the copy button:

Get Model ID

Edit Node

Step 3: Save and Test

Click the “Save” button in the top-right corner, then open the chat interface to test your agent:

Save and Test the Agent

Your Flowise application is now integrated with TrueFoundry’s AI Gateway and ready for use.