OpenAI Moderation Integration

This guide explains how to integrate OpenAI Moderation with TrueFoundry to enhance the safety and compliance of your LLM applications.

​

Adding OpenAI Moderation Integration

To add OpenAI Moderation to your TrueFoundry setup, follow these steps:

1. Navigate to AI Gateway

   • Go to AI Gateway in your TrueFoundry dashboard.

2. Access Guardrails

   • Click on Guardrails.

3. Add New Guardrails Group

   • Click on Add New Guardrails Group.

Guardrails groups help manage access control and security policies for your LLM applications. Configure rules to prevent harmful content, ensure compliance, and maintain data privacy. For more details, refer to the Collaborator Section.

4. Fill in the Guardrails Group Form
   • Name: Enter a name for your guardrails group.
   • Collaborators: Add collaborators who will have access to this group.
   • OpenAI Moderation Guardrail Config:
     • Name: Enter a name for the OpenAI Moderation configuration.
     • Base URL (Optional): Specify the base URL if needed.
     • API Key: Enter your OpenAI API key.
     • OpenAI Moderation Mode: Choose the moderation mode. This defaults to omni-moderation-latest.

By following these steps, you can effectively integrate OpenAI Moderation into your TrueFoundry environment, ensuring your applications adhere to safety and compliance standards.