TrueFoundry AI Gateway supports two types of cost tracking for models:
Add Public Cost
Public cost refers to the pre-configured pricing information available for commonly used models. This is provided on a best-effort basis and may not be available for all models. When you select a model that has public cost enabled:
This feature simplifies cost management for standard models from providers like OpenAI, Anthropic, and AWS Bedrock.
When adding a model through the + Add Model
form or editing an existing model, you’ll see an option to enable public cost if it’s available for that specific model.
For models where we are not able to support public pricing or you need custom pricing (e.g. custom pricing contracts with providers) or for fine-tuned models:
Add Private Cost
To set up private cost:
To update private cost for an existing model:
This flexibility allows you to accurately track costs for any model deployment scenario.
TrueFoundry AI Gateway supports two types of cost tracking for models:
Add Public Cost
Public cost refers to the pre-configured pricing information available for commonly used models. This is provided on a best-effort basis and may not be available for all models. When you select a model that has public cost enabled:
This feature simplifies cost management for standard models from providers like OpenAI, Anthropic, and AWS Bedrock.
When adding a model through the + Add Model
form or editing an existing model, you’ll see an option to enable public cost if it’s available for that specific model.
For models where we are not able to support public pricing or you need custom pricing (e.g. custom pricing contracts with providers) or for fine-tuned models:
Add Private Cost
To set up private cost:
To update private cost for an existing model:
This flexibility allows you to accurately track costs for any model deployment scenario.