This guide provides instructions for integrating LibreChat with the Truefoundry AI Gateway.

​
What is LibreChat?

LibreChat is a free, open-source platform that allows users to deploy and interact with various AI chat interfaces, like ChatGPT and Gemini, in one place.

​
Key Features of LibreChat

  1. Multi-Provider AI Support: LibreChat integrates with multiple AI services including OpenAI, Anthropic, AWS Bedrock, and Google, allowing users to switch between different models seamlessly within a single interface. This flexibility enables users to choose the most suitable model for their specific tasks.
  2. Code Interpreter API: Execute code securely in multiple programming languages including Python, JavaScript, TypeScript, Go, C/C++, Java, PHP, Rust, and Fortran without requiring local setup. This feature enables advanced code analysis and execution capabilities directly within chat conversations.
  3. Custom AI Agents: Create specialized AI assistants without coding by integrating tools like DALL-E-3, semantic search, calculators, and other APIs. These no-code agents can be customized for specific workflows and business requirements, enhancing productivity through automated assistance.

​
Prerequisites

To use TrueFoundry’s AI Gateway follow the quick start guide here.

​
Getting Base URL and Model Names

  • Base URL and Model Names: Get your TrueFoundry AI Gateway endpoint URL and model name from the unified code snippet (ensure you have added the same model name)
  • PAT: Generate from your TrueFoundry Personal Access Token PAT

​
Using TrueFoundry AI Gateway with any LLM model

      - name: "TrueFoundry"
        apiKey: "${TRUEFOUNDRY_API_KEY}"
        baseURL: "${TRUEFOUNDRY_GATEWAY_URL}"
        models:
            default: ["openai-main/gpt-4o-mini", "openai-main/gpt-4o"]
            fetch: true
        titleConvo: true
        titleModel: "current_model"
        summarize: false
        summaryModel: "current_model"
        forcePrompt: false
        modelDisplayLabel: "TrueFoundry:OpenAI"
For more details you can check: TrueFoundry Docs