Getting Started
1. Create a MCP Server Group
MCP Server Groups help you cluster MCP servers and govern who can access or manage the MCP servers in the group. To add a MCP server to the Gateway, you first need to create a MCP server group and then add the MCP server to the group.
An example usecase of multiple MCP server groups will be to have a dev-mcps group for development and a prod-mcps group for production.
dev-mcps: All developers can add/edit/remove MCP servers from the group and also use the MCP servers in the group.prod-mcps: Only admins can add/edit/remove MCP servers from this group and only production applications can use the MCP servers in this group.
You can also maintain a group per team or project based on your organization’s needs.
To create a MCP server group, follow the steps below:
-
Navigate to the MCP Servers section in the AI Gateway UI and click Add New MCP Server Group.
-
Configure the group with the following:
Name: Enter a descriptive identifier (e.g.,dev-mcps,prod-mcps)Access Control: Configure access permissionsUser: Allows users to access and use the MCP integrationsManage: Allows users to create, update, or delete integrations and change their configuration
MCP Server Groups Interface
2. Add a MCP Server to Group
To add an MCP server, you can either create one from scratch or add a public MCP server. To add MCP server, click on Add/Edit MCP Server button inside MCP Group and then provide the following details to add the server:
Name: A descriptive name for the MCP serverDescription: A description of the MCP serverEndpoint URL: The URL of the MCP serverAuth Data: The authentication mechanism to use for the MCP server. This can either beNo Auth,Header AuthorOAuth2.
Below are three sample MCP servers that you can use to get started. If you have your own MCP server, you can also integrate that.
Create Calculator MCP Server (No Auth)
Create Calculator MCP Server (No Auth)
Let’s create a simple calculator MCP server that provides basic math operations.
Run locally:
Your MCP server will be available at http://localhost:8000/mcp.
We have already added this code to a Github Repo and deployed it on our live demo link:
Repository: You can find the complete example code at: Calculator MCP Server
Deployment: You can find the live demo link at: Calculator MCP Server Deployment
Server Endpoint: The MCP server can be accessed at this endpoint: https://calculator-mcp-server.apps.live-demo.truefoundry.cloud
To add this MCP server to your MCP group, provide the following details:
Name: calculator-mcp-serverEndpoint URL: https://calculator-mcp-server.apps.live-demo.truefoundry.cloudDescription: A simple calculator MCP serverAuthentication: No Auth
Deepwiki MCP Server (No Auth)
Deepwiki MCP Server (No Auth)
Deepwiki is a public MCP server that provides access to the DeepWiki repository documentation.
Fill in the following details in the MCP server section:
Name: deepwiki-mcpEndpoint URL: https://mcp.deepwiki.com/mcpDescription: Access to DeepWiki’s repository documentationAuthentication: None (Disabled)
Hugging Face MCP Server (Header Auth)
Hugging Face MCP Server (Header Auth)
HuggingFace MCP server requires Header Based Authentication and you will need the API token from the HuggingFace account.
Once you get the token, you can add the following details in the MCP server form:
- Name:
hf-mcp-server - Endpoint URL:
https://huggingface.co/mcp - Authentication: Header Authentication
- Header Name:
Authorization - Header Value:
Bearer <YOUR_HF_TOKEN>
3. Use MCP Servers in Playground
You can select the MCP servers from the playground, select the tools and send your prompt to see which tools are being called.
Use MCP Servers in Code
Follow Use MCP Servers in Code Agent to use your MCP servers in your code agent.