1. Create a MCP Server Group

MCP Server Groups help you cluster MCP servers and govern who can access or manage the MCP servers in the group. To add a MCP server to the Gateway, you first need to create a MCP server group and then add the MCP server to the group.

An example usecase of multiple MCP server groups will be to have a dev-mcps group for development and a prod-mcps group for production.

  • dev-mcps: All developers can add/edit/remove MCP servers from the group and also use the MCP servers in the group.
  • prod-mcps: Only admins can add/edit/remove MCP servers from this group and only production applications can use the MCP servers in this group.

You can also maintain a group per team or project based on your organization’s needs.

To create a MCP server group, follow the steps below:

  1. Navigate to the MCP Servers section in the AI Gateway UI and click Add New MCP Server Group.

  2. Configure the group with the following:

    • Name: Enter a descriptive identifier (e.g., dev-mcps, prod-mcps)
    • Access Control: Configure access permissions
      • User: Allows users to access and use the MCP integrations
      • Manage: Allows users to create, update, or delete integrations and change their configuration

MCP Server Groups Interface

2. Add a MCP Server to Group

To add an MCP server, you can either create one from scratch or add a public MCP server. To add MCP server, click on Add/Edit MCP Server button inside MCP Group and then provide the following details to add the server:

  • Name: A descriptive name for the MCP server
  • Description: A description of the MCP server
  • Endpoint URL: The URL of the MCP server
  • Auth Data: The authentication mechanism to use for the MCP server. This can either be No Auth, Header Auth or OAuth2.

Below are three sample MCP servers that you can use to get started. If you have your own MCP server, you can also integrate that.

3. Use MCP Servers in Playground

You can select the MCP servers from the playground, select the tools and send your prompt to see which tools are being called.

Use MCP Servers in Code

Follow Use MCP Servers in Code Agent to use your MCP servers in your code agent.