LLM Playground

The LLM Playground is a UI for the LLM Gateway where you can interact with the various models you've added. Below is an overview of the features:

Features

  1. Support for multiple model types
    1. Chat Models
    2. Completion Models
    3. Embedding Models
  2. Image Upload: Upload images for image captioning or visual question answering. This is only available for models that support images such as GPT-4o
  3. Model Comparison: Compare responses from different completion models to evaluate their performance.
  4. System Prompts: Use predefined system prompts to guide model behaviour.System prompt inform how the model should respond. Sample system prompt - Be clear, concise, and polite in your responses. Avoid sharing any sensitive or personal information.