Generic
Provisioning control plane in Generic cluster
There are steps in this guide where Truefoundry team will have to be involved. Please reach out to [email protected] to get the credentials
Setting up Truefoundry control plane on a generic cluster involves creating the infrastructure to support the platform and then installing the platform itself.
Generic cluster refers to those cluster which are not managed by any cloud provider.
Setting up Infrastructure
Infrastructure requirements
Requirements | Description | Reason for Requirement |
---|---|---|
Kubernetes Cluster | Any Kubernetes cluster will work here - we can also choose the compute-plane cluster itself to install Truefoundry helm chart. Min 4vCPU and 8GB RAM | The Truefoundry helm chart will be installed here. |
Postgres database | Postgres >= 13 | The database is used by Truefoundry control plane to store all its metadata and can be installed through the truefoundry helm chart. |
Volume | Default storage class to support dynamic volumes | Volumes are required for databases and statefulsets |
Egress Access for TruefoundryAuth | Egress access to https://auth.truefoundry.com | This is needed to verify the users logging into the Truefoundry platform for licensing purposes |
Egress access For Docker Registry | 1. public.ecr.aws 2. quay.io 3. ghcr.io 4. docker.io/truefoundrycloud 5. docker.io/natsio 6. nvcr.io 7. registry.k8s.io | This is to download docker images for Truefoundry, ArgoCD, NATS, ArgoRollouts, ArgoWorkflows, Istio. |
DNS with TLS/SSL | One endpoint to point to the control plane service (something like platform.example.com where example.com is your domain. There should also be a certificate with the domain so that the domains can be accessed over TLS. The control-plane url should be reachable from the compute-plane so that compute-plane cluster can connect to the control-plane | The developers will need to access the Truefoundry UI at domain that is provided here. |
Installing TrueFoundry
Pre-requisites
- Installing helm
- Add the following chart repository
helm repo add argocd https://argoproj.github.io/argo-helm helm repo add truefoundry https://truefoundry.github.io/infra-charts/
- Updating helm repo to download the latest local repository index
helm repo update argocd truefoundry
Installing truefoundry helm chart
-
Installing
argocd
helm charthelm upgrade --install argocd argocd/argo-cd -n argocd \ --create-namespace \ --version 7.4.4 \ --set applicationSet.enabled=false \ --set notifications.enabled=false \ --set dex.enabled=false
-
Create
values.yaml
for the truefoundry helm chart.## @param tenantName Parameters for tenantName ## Tenant Name - This is same as the name of the organization used to sign up ## on Truefoundry ## tenantName: "" ## @param controlPlaneURL Parameters for controlPlaneURL ## URL of the control plane - This is the URL that can be used by workload to access the truefoundry components ## controlPlaneURL: "" ## @param clusterName Name of the cluster ## Name of the cluster that you have created on AWS/GCP/Azure ## clusterName: "" ## @section notebookController parameters ## Notebook Controller is required to power notebooks in Truefoundry ## notebookController: enabled: false defaultStorageClass: "" ## @section tfyAgent parameters tfyAgent: enabled: false ## @param truefoundry.enabled Flag to enable TrueFoundry ## This installs the Truefoundry control plane helm chart. You can make it true ## if you want to install Truefoundry control plane. ## truefoundry: enabled: true ## @param truefoundry.devMode.enabled Flag to enable TrueFoundry Dev mode. Postgres will run ## devMode: enabled: true truefoundryBootstrap: enabled: true tfyK8sController: enabled: false truefoundryFrontendApp: replicaCount: 2 istio: virtualservice: enabled: true gateways: ["istio-system/tfy-wildcard"] hosts: - "" tfyWorkflowAdmin: enabled: false database: host: "" name: "" username: "" password: "" ## @param global.tfyApiKey API key for truefoundry ## tfyApiKey: "" ## @param global.truefoundryImagePullConfigJSON JSON config for image pull secret ## truefoundryImagePullConfigJSON: ""
-
Fill the following values
tenantName
- name of the tenant. If you haven't created one. please do it herecontrolPlaneURL
- URL at which to host the platform (for e.g.https://truefoundry.example.com
)clusterName
- name of the cluster
-
For the remaining values
truefoundry.tfyApiKey
- api key to given by TrueFoundry teamtruefoundry.truefoundryImagePullConfigJSON
- Image pull config JSON to be given by TrueFoundry teamtruefoundry.truefoundryFrontendApp.istio.hosts[0]
- control plane URL without protocol
-
Run the following command to install the chart
helm upgrade --install tfy-k8s-generic-inframold \ truefoundry/tfy-k8s-generic-inframold \ -f values.yaml -n argocd
-
Once the helm chart is installed, point the control plane URL to the load balancer's IP address. To get the IP address of the load balancer
kubectl get svc tfy-istio-ingress -n istio-system
- We will also need the TLS certificates to be passed to the load balancer (in our case istio) to terminate the TLS traffic.
- Login in the control plane URL with the same credentials used to register the tenant.
Add the compute plane
- Add the same cluster as the compute-plane from the UI and get the cluster token
- Add the token in the values.yaml and run the helm install command
## @section tfyAgent parameters tfyAgent: enabled: false clusterToken: ""
- The control plane URL should be reachable to from inside of the k8s cluster as the
tfy-agent
will use the control plane URL to initiate the connection to the control plane. - Helm
helm upgrade --install tfy-k8s-generic-inframold \ truefoundry/tfy-k8s-generic-inframold \ -f values.yaml -n argocd
Adding domain to Load balancer
- We need to add one more domain to the load balancer so that a separate domain can be used to host the workloads only. This domain can be a wildcard (recommended) as well.
- To add the domain
- Point the domain to the load balancer IP address.
- Pass the TLS certificate to istio so that it can terminate the TLS traffic.
- Add the domain in the platform.
Adding docker registry
Check the integrations section to know more on this
Updated 7 days ago