Skip to main content

​
1. Create an MCP Server Group

MCP Server Groups help you cluster MCP servers and govern who manage the MCP servers. To add an MCP server to the Gateway, you first need to create a MCP server group and then add the MCP server to the group.
Groups help teams manage the MCP server integrations. You can add managers at a group level and can control who can use what MCP server at an individual MCP server level.For example, you can have an MCP Server group called platform-mcp-servers and let the platform team manage it. Members of the platform team will be able add/edit/delete MCP servers and give other users access to them.
To create an MCP server group, follow the steps below:
  1. Navigate to the MCP Servers section in the AI Gateway UI and click Add New MCP Group.
  2. Configure the group with the following:
    • Name: Enter a descriptive identifier (e.g., platform-mcp-servers, saas-mcp-servers)
    • Managers: List of teams/users who can manage this MCP Server Group. These subjects can add new MCP server integrations, can edit existing ones and can also use the MCP server.
MCP Server Group Form

​
2. Add an MCP Server to Group

Add MCP Server To add an MCP server, you can either create one from scratch or add a public MCP server. Screenshot2025 10 17at18 25 06 Pn To add a custom Remote MCP server, click on Remote MCP button and then provide the following details to add the server:
  • Name: A descriptive name for the MCP server.
  • Description: A description of the MCP server.
  • URL: The URL of the MCP server.
  • Transport: streamable-http or sse. Note that sse is deprecated.
  • Access Control: List of teams/users who can use this MCP server.
  • Auth Data: The authentication mechanism to use for the MCP server. This can either be No Auth, Header Auth , DCR , OAuth2. /2025-10-29_02.43.12.png Below we have a sample MCP server that you can use to get started. If you have your own MCP server, you can also integrate that.
Let’s create a simple calculator MCP server that provides basic math operations.
from fastmcp import FastMCP

mcp = FastMCP("Calculator MCP Server")

@mcp.tool
def add(a: int, b: int) -> int:
    """Add two numbers"""
    return a + b

@mcp.tool
def subtract(a: int, b: int) -> int:
    """Subtract two numbers"""
    return a - b

@mcp.tool
def multiply(a: int, b: int) -> int:
    """Multiply two numbers"""
    return a * b

@mcp.tool
def divide(a: float, b: float) -> float:
    """Divide two numbers"""
    if b == 0:
        raise ValueError("Cannot divide by zero")
    return a / b

@mcp.tool
def power(a: int, b: int) -> int:
    """Raise a number to the power of another number"""
    return a ** b

if __name__ == "__main__":
    mcp.run(transport="http", host="0.0.0.0", port=8000, path="/mcp")
Run locally:
# Install dependencies
pip install -r requirements.txt

# Run the server
python server.py
Your MCP server will be available at http://localhost:8000/mcp.
We have already added this code to a Github Repo and deployed it on our live demo link:Repository: You can find the complete example code at: Calculator MCP ServerDeployment: You can find the live demo link at: Calculator MCP Server DeploymentServer Endpoint: The MCP server can be accessed at this endpoint: https://calculator-mcp-server.apps.live-demo.truefoundry.cloud
To add this MCP server to your MCP group, provide the following details:

​
3. Use MCP Servers in Playground

You can select the MCP servers from the playground, select the tools and send your prompt to see which tools are being called.

​
4. Use MCP Servers in Code

Follow Use MCP Servers in Code Agent to use your MCP servers in your code agent.