Quick Start

TrueFoundry offers a secure and efficient gateway to seamlessly integrate various Large Language Models (LLMs) into your applications, including models hosted on OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure OpenAI and many more. View Full List

​

Providers and Models

Before we start integrating LLMs, let’s quickly understand the concept of a Provider and a Model:

Provider - A provider is an organization or company that supplies access to various AI language models. These providers offer multiple models, each varying in performance, features, and pricing. Prominent examples of such providers include OpenAI and Anthropic, which deliver a range of models designed to meet different needs.

Model - A model refers to a specific implementation of an AI language model made available by a provider. Each model is tailored with unique features and trained on distinct datasets, which influences its performance and suitability for various tasks. For example, OpenAI’s GPT-3 and GPT-4 are different models, each offering unique capabilities to cater to diverse applications.

​

Quick Start from Login to Model Addition

• Go to TrueFoundry Website.

• Click on Signup button.

• Create an account and verify your email. You will be redirected to the landing page.

• Click on Setup AI Gateway card.

​

Add Provider Account

• Click on Provider Account from the list.

• Fill the form and select the model from the list of checkboxes.

• In case the model is not available in the list, click on +Add Model at the bottom of the form.

• Fill the form and click on Add Model and then Add OpenAI Account.

• You will see the list of provider accounts added and the models in those provider accounts.

• You can click on Try in Playground button to try out the model in the playground.

​

Add Models

• In case you want to add more models, you can do so by traversing to AI Gateway tab and then Models tab. You will see list of provider accounts on the left side, select the provider account and then click on Add Model button on top right corner.
• Click on Add Model button on top right corner.
• Follow the above steps to add models from any of the supported providers.

​

LLM Playground

The LLM Playground is a UI for the AI Gateway where you can tryout different models you’ve added from across providers like OpenAI, Mistral, Cohere etc. Below is an overview of the features:

1. Support for multiple model types

   1. Chat Models
   2. Embedding Models
   3. Rerank Models
   4. Realtime Models

2. Image Upload: Upload images for image captioning or visual question answering. This is only available for models that support images such as GPT-4o.

3. Model Comparison: Compare responses from different completion models to evaluate their performance.

4. System Prompts: Use predefined system prompts to guide model behaviour. System prompt inform how the model should respond. Sample system prompt - Be clear, concise, and polite in your responses. Avoid sharing any sensitive or personal information.