LLM Playgound

The LLM Playground is a UI for the LLM Gateway where you can tryout different models you've added from across providers like OpenAI, Mistral, Cohere etc. Below is an overview of the features:

1. Support for multiple model types
   1. Chat Models
   2. Embedding Models
   3. Rerank Models
   4. Realtime Models
2. Image Upload: Upload images for image captioning or visual question answering. This is only available for models that support images such as GPT-4o.
3. Model Comparison: Compare responses from different completion models to evaluate their performance.
4. System Prompts: Use predefined system prompts to guide model behaviour. System prompt inform how the model should respond. Sample system prompt - Be clear, concise, and polite in your responses. Avoid sharing any sensitive or personal information.