Truefoundry Docs

1. Create a MCP Server Group

MCP Server Groups help you cluster MCP servers and govern who can access or manage the MCP servers in the group. To add a MCP server to the Gateway, you first need to create a MCP server group and then add the MCP server to the group.

An example usecase of multiple MCP server groups will be to have a dev-mcps group for development and a prod-mcps group for production.

dev-mcps: All developers can add/edit/remove MCP servers from the group and also use the MCP servers in the group.
prod-mcps: Only admins can add/edit/remove MCP servers from this group and only production applications can use the MCP servers in this group.

You can also maintain a group per team or project based on your organization’s needs.

To create a MCP server group, follow the steps below:

Navigate to the MCP Servers section in the AI Gateway UI and click Add New MCP Server Group.
Configure the group with the following:
- Name: Enter a descriptive identifier (e.g., dev-mcps, prod-mcps)
- Access Control: Configure access permissions
  - User: Allows users to access and use the MCP integrations
  - Manage: Allows users to create, update, or delete integrations and change their configuration

MCP Server Groups Interface

2. Add a MCP Server to Group

To add an MCP server, you can either create one from scratch or add a public MCP server. To add MCP server, click on Add/Edit MCP Server button inside MCP Group and then provide the following details to add the server:

Name: A descriptive name for the MCP server
Description: A description of the MCP server
Endpoint URL: The URL of the MCP server
Auth Data: The authentication mechanism to use for the MCP server. This can either be No Auth, Header Auth or OAuth2.

Below are three sample MCP servers that you can use to get started. If you have your own MCP server, you can also integrate that.

Create Calculator MCP Server (No Auth)

Let’s create a simple calculator MCP server that provides basic math operations.

from fastmcp import FastMCP

mcp = FastMCP("Calculator MCP Server")

@mcp.tool
def add(a: int, b: int) -> int:
    """Add two numbers"""
    return a + b

@mcp.tool
def subtract(a: int, b: int) -> int:
    """Subtract two numbers"""
    return a - b

@mcp.tool
def multiply(a: int, b: int) -> int:
    """Multiply two numbers"""
    return a * b

@mcp.tool
def divide(a: float, b: float) -> float:
    """Divide two numbers"""
    if b == 0:
        raise ValueError("Cannot divide by zero")
    return a / b

@mcp.tool
def power(a: int, b: int) -> int:
    """Raise a number to the power of another number"""
    return a ** b

if __name__ == "__main__":
    mcp.run(transport="http", host="0.0.0.0", port=8000, path="/mcp")

Run locally:

# Install dependencies
pip install -r requirements.txt

# Run the server
python server.py

Your MCP server will be available at http://localhost:8000/mcp.

We have already added this code to a Github Repo and deployed it on our live demo link:Repository: You can find the complete example code at: Calculator MCP ServerDeployment: You can find the live demo link at: Calculator MCP Server DeploymentServer Endpoint: The MCP server can be accessed at this endpoint: https://calculator-mcp-server.apps.live-demo.truefoundry.cloud

To add this MCP server to your MCP group, provide the following details:

Name: calculator-mcp-server
Endpoint URL: https://calculator-mcp-server.apps.live-demo.truefoundry.cloud
Description: A simple calculator MCP server
Authentication: No Auth

Deepwiki MCP Server (No Auth)

Hugging Face MCP Server (Header Auth)

3. Use MCP Servers in Playground

You can select the MCP servers from the playground, select the tools and send your prompt to see which tools are being called.

Use MCP Servers in Code

Follow Use MCP Servers in Code Agent to use your MCP servers in your code agent.

Get Started

Developer Guide

MCP Registry and Gateway

Observability

Integrations

Deployment

API Reference

Chat

Agent

MCP

Embeddings

Rerank

Responses

Image

Audio

Batch

Files

Moderations

Getting Started

1. Create a MCP Server Group

2. Add a MCP Server to Group

3. Use MCP Servers in Playground

Use MCP Servers in Code

Get Started

Developer Guide

MCP Registry and Gateway

Observability

Integrations

Deployment

API Reference

Chat

Agent

MCP

Embeddings

Rerank

Responses

Image

Audio

Batch

Files

Moderations

​1. Create a MCP Server Group

​2. Add a MCP Server to Group

​3. Use MCP Servers in Playground

​Use MCP Servers in Code

1. Create a MCP Server Group

2. Add a MCP Server to Group

3. Use MCP Servers in Playground

Use MCP Servers in Code