Skip to main content
Truefoundry provides different deployment options depending on your cloud provider, existing infrastructure and the components that you want to deploy. Before understanding the different deployment options, its important to read about the overall architecture here: control-plane architecture, compute-plane architecture, gateway-plane architecture.
Deployment ScenarioModulesPricing TierRemarksCost of Hosting
AI Gateway SAAS onlyGatewayStarterUse managed AI Gateway for LLM requests, no compute plane or control plane hosting needed.0
Gateway Plane onlyGatewayEnterpriseHost the Gateway plane for LLM requests and use control-plane hosted by Truefoundry.~$600/month
Compute Plane onlyAI DeploymentProHost the compute plane for model/services deployment, control-plane hosted by Truefoundry.Fixed cost of ~$200/month. Cost scales as compute plane scales.
Compute Plane + Control PlaneAI DeploymentEnterpriseComplete self-hosted for AI Deployment, full control over infra, no Gateway product.Fixed cost ~ $600/month. Cost scales as compute plane scales.
Compute Plane + AI Gateway SAASAI Deployment, AI GatewayProDeploy models/services (Compute Plane) on your own infrastructure while using managed AI GatewayFixed cost of ~ $200/month. Cost scales as compute plane scales.
Control Plane + Gateway PlaneAI GatewayEnterpriseUse only AI Gateway, full control, suitable if you don’t need compute plane/app deployment.~ $800-1000/month.
Control Plane + Gateway Plane + Compute PlaneAI Deployment, AI GatewayEnterpriseFull flexibility, full control; self-host the entire platform.Fixed cost ~$1200/month. Cost scales as the compute plane scales and requests through gateway scales.
The key options described above are:
  1. AI Gateway SAAS only: This is a fully managed solution on Truefoundry’s secure cloud infrastructure with enterprise-grade features. You don’t need to deploy any infrastructure on your end. To read about how the SAAS solution works, please refer to Truefoundry Managed SAAS.
  2. Gateway Plane only: Host the Gateway plane for LLM requests and use control-plane hosted by Truefoundry.
  3. Compute Plane only: Host the compute plane for model/services deployment, control-plane hosted by Truefoundry.
  4. Compute Plane + Control Plane: Complete self-hosted for AI Deployment, full control over infra, no Gateway product.
  5. Compute Plane + AI Gateway SAAS: Deploy models/services (Compute Plane) on your own infrastructure while using managed AI Gateway.
  6. Control Plane + Gateway Plane: Use only AI Gateway, full control, suitable if you don’t need compute plane/app deployment.
  7. Control Plane + Gateway Plane + Compute Plane: Full flexibility, full control; self-host the entire platform.