Flowise is an open-source LLM application builder that enables users to create LLM applications using drag-and-drop tools. TrueFoundry integrates seamlessly with Flowise, allowing you to deploy your Flowise applications through TrueFoundry’s Gateway.
TrueFoundry’s AI Gateway provides comprehensive integration with Flowise, routing all LLM calls through the Gateway to ensure your applications are secure, compliant, and cost-effective through the Gateway’s built-in features.
Before integrating Flowise with TrueFoundry, ensure you have the following:
Authentication Token: Create a Personal Access Token or Virtual Account in TrueFoundry by following the instructions in Generating Tokens. This token will authenticate your Flowise application to the TrueFoundry Gateway.
Gateway Base URL: Locate your TrueFoundry Gateway base URL, which follows the format <control plane url>/api/llm
. The control plane URL is where your TrueFoundry dashboard is hosted (e.g., https://company.truefoundry.cloud/api/llm
).
Flowise Account: Set up a Flowise account using either the open-source version for local deployment or the SaaS version.
This guide assumes you have an active Flowise account and have obtained your TrueFoundry AI Gateway base URL and authentication token.
Add your TrueFoundry credentials to Flowise:
Flowise Credentials
Select “OpenAI Custom” from the dropdown menu:
OpenAI Custom
Enter your TrueFoundry token as the credential.
AgentFlow
Add Node
Edit Node
Get Model ID
Edit Node
Click the “Save” button in the top-right corner, then open the chat interface to test your agent:
Save and Test the Agent
Your Flowise application is now integrated with TrueFoundry’s AI Gateway and ready for use.
Flowise is an open-source LLM application builder that enables users to create LLM applications using drag-and-drop tools. TrueFoundry integrates seamlessly with Flowise, allowing you to deploy your Flowise applications through TrueFoundry’s Gateway.
TrueFoundry’s AI Gateway provides comprehensive integration with Flowise, routing all LLM calls through the Gateway to ensure your applications are secure, compliant, and cost-effective through the Gateway’s built-in features.
Before integrating Flowise with TrueFoundry, ensure you have the following:
Authentication Token: Create a Personal Access Token or Virtual Account in TrueFoundry by following the instructions in Generating Tokens. This token will authenticate your Flowise application to the TrueFoundry Gateway.
Gateway Base URL: Locate your TrueFoundry Gateway base URL, which follows the format <control plane url>/api/llm
. The control plane URL is where your TrueFoundry dashboard is hosted (e.g., https://company.truefoundry.cloud/api/llm
).
Flowise Account: Set up a Flowise account using either the open-source version for local deployment or the SaaS version.
This guide assumes you have an active Flowise account and have obtained your TrueFoundry AI Gateway base URL and authentication token.
Add your TrueFoundry credentials to Flowise:
Flowise Credentials
Select “OpenAI Custom” from the dropdown menu:
OpenAI Custom
Enter your TrueFoundry token as the credential.
AgentFlow
Add Node
Edit Node
Get Model ID
Edit Node
Click the “Save” button in the top-right corner, then open the chat interface to test your agent:
Save and Test the Agent
Your Flowise application is now integrated with TrueFoundry’s AI Gateway and ready for use.