Go to the AI Gateway Tab from the left sidebar and click on Models tab and select your provider from the list.
You can add multiple API keys from the same provider by creating multiple provider accounts.
In case you want to add more models, you can do so by traversing to AI Gateway tab and then Models tab. You will see list of provider accounts on the left side, select the provider account and then click on Add Model button on top right corner.
Click on Add Model button on top right corner.
Follow the provider account setup steps to add models from any of the supported providers.
The LLM Playground is a UI for the AI Gateway where you can tryout different models you’ve added from across providers like OpenAI, Mistral, Cohere etc. Below is an overview of the features:
AI Gateway Playground Page
You can click on Try in Playground button to try out the model in the playground. (if you are on the listing page)
Image Upload: Upload images for image captioning or visual question answering. This is only available for models that support images such as GPT-4o.
System Prompts: Use predefined system prompts to guide model behaviour. System prompt inform how the model should respond. Sample system prompt - Be clear, concise, and polite in your responses. Avoid sharing any sensitive or personal information.
If you have any questions, please reach out to us at support@truefoundry.com or book a demo with our team here.
