Getting Started
Create a MCP Server Group
MCP Server Groups help you cluster MCP servers and govern who can access or manage the MCP servers in the group. To add a MCP server to the Gateway, you first need to create a MCP server group and then add the MCP server to the group.
An example usecase of multiple MCP server groups will be to have a dev-mcps group for development and a prod-mcps group for production.
dev-mcps: All developers can add/edit/remove MCP servers from the group and also use the MCP servers in the group.prod-mcps: Only admins can add/edit/remove MCP servers from this group and only production applications can use the MCP servers in this group.
You can also maintain a group per team or project based on your organization’s needs.
To create a MCP server group, follow the steps below:
-
Navigate to the MCP Servers section in the AI Gateway UI and click Add New MCP Server Group.
-
Configure the group with the following:
Name: Enter a descriptive identifier (e.g.,dev-mcps,prod-mcps)Access Control: Configure access permissionsUser: Allows users to access and use the MCP integrationsManage: Allows users to create, update, or delete integrations and change their configuration
MCP Server Groups Interface
Add a MCP Server to Group
To add an MCP server, you can either create one from scratch or add a public MCP server. With each MCP server, you can will need to define the authentication mechanism: No Auth, Header Auth or OAuth2. There are examples of 3 MCP servers below: you can choose any one or multiple to get the MCP server details.
Create Calculator MCP Server (No Auth)
Create Calculator MCP Server (No Auth)
Let’s create a simple calculator MCP server that provides basic math operations.
Run locally:
Your MCP server will be available at http://localhost:8000/mcp.
We have already added this code to a Github Repo and deployed it on our live demo link:
Repository: You can find the complete example code at: Calculator MCP Server
Deployment: You can find the live demo link at: Calculator MCP Server Deployment
Server Endpoint: The MCP server can be accessed at this endpoint: https://calculator-mcp-server.apps.live-demo.truefoundry.cloud
Deepwiki MCP Server (No Auth)
Deepwiki MCP Server (No Auth)
Deepwiki is a public MCP server that provides access to the DeepWiki repository documentation.
- Click on the Add MCP Server button inside MCP Group.
- Fill in the following details:
Name: deepwiki-mcpEndpoint URL: https://mcp.deepwiki.com/mcpDescription: Access to DeepWiki’s repository documentationAuthentication: None (Disabled)
DeepWiki MCP Server Setup
Hugging Face MCP Server (Header Auth)
Hugging Face MCP Server (Header Auth)
Get HuggingFace Token
Get your API token from Hugging Face Settings.
Add Server
In the AI Gateway, add a new MCP Server:
- Name:
hf-mcp-server - Endpoint URL:
https://huggingface.co/mcp - Authentication: Header Authentication
- Header Name:
Authorization - Header Value:
Bearer <YOUR_HF_TOKEN>
Hugging Face MCP Server Setup
Adding Servers to Groups
Select Group
Click on your MCP Server Group (e.g., dev-mcps).
Add MCP Server
Click Add MCP Server.
Complete Form
Fill in server details:
- Name: Server identifier
- Endpoint URL: Your server’s URL
- Description: What this server does
- Authentication: Choose method (None, Header, OAuth2)
Add MCP Server Form
Use MCP Servers in Playground
- Click Add MCP Servers to select tools from your registered MCP Servers.
MCP Server Playground Landing Page - AI Gateway
- Choose the tools you want to use and click Done to add them to your Playground session.
MCP Server Playground Select Tools Page - AI Gateway
- Enter your prompt and click Run to see the response from your selected tool.
Example Playground Run
Before using the Playground, ensure your MCP Server is registered in the AI Gateway.
Use MCP Servers in Code
Follow Use MCP Servers in Code Agent to use your MCP servers in your code agent.