Pre-built Truefoundry Machine Learning Container Images

When a model is deployed in Truefoundry, it uses a pre-built ready-to-use image built for the purpose. All such images can be found documented here.

Docker Image for HuggingFace Models using Multi Model Server.

Docker ImageResources Required
docker.io/truefoundrycloud/tfy-inference-toolkit:cpu-0.2.3CPU
docker.io/truefoundrycloud/tfy-inference-toolkit:gpu-0.2.3GPU