Flowise is an open-source LLM application builder that enables users to create LLM applications using drag-and-drop tools. TrueFoundry integrates seamlessly with Flowise, allowing you to deploy your Flowise applications through TrueFoundry’s Gateway.

TrueFoundry’s AI Gateway provides comprehensive integration with Flowise, routing all LLM calls through the Gateway to ensure your applications are secure, compliant, and cost-effective through the Gateway’s built-in features.

​

Prerequisites

Before integrating Flowise with TrueFoundry, ensure you have the following:

1. Authentication Token: Create a Personal Access Token or Virtual Account in TrueFoundry by following the instructions in Generating Tokens. This token will authenticate your Flowise application to the TrueFoundry Gateway.

2. Gateway Base URL: Locate your TrueFoundry Gateway base URL, which follows the format <control plane url>/api/llm. The control plane URL is where your TrueFoundry dashboard is hosted (e.g., https://company.truefoundry.cloud/api/llm).

3. Flowise Account: Set up a Flowise account using either the open-source version for local deployment or the SaaS version.

​

Configuration Steps

This guide assumes you have an active Flowise account and have obtained your TrueFoundry AI Gateway base URL and authentication token.

​

Step 1: Configure Flowise Credentials

Add your TrueFoundry credentials to Flowise:

Select “OpenAI Custom” from the dropdown menu:

Enter your TrueFoundry token as the credential.

​

Step 2: Create an Agent

1. In the left sidebar, select “AgentFlow” and click “Add Node”:

2. Ensure you create a connection from the Start node to your AgentFlow node.

3. Retrieve the model ID from the TrueFoundry Dashboard using the copy button:

​

Step 3: Save and Test

Click the “Save” button in the top-right corner, then open the chat interface to test your agent:

Your Flowise application is now integrated with TrueFoundry’s AI Gateway and ready for use.