Skip to main content
TrueFoundry AI Gateway makes it easy to track and manage costs for all your AI model usage. This guide walks you through setting up cost tracking, viewing detailed breakdowns, and analyzing your spending.

​
Setting Up Cost Tracking

To set up cost tracking for your AI models:
  1. From the TrueFoundry dashboard, navigate to AI Gateway > Models
  2. Select any Provider Account
  3. Click on the Edit button for an existing model or + Add Model to create a new one
  4. In the model configuration screen, you’ll find cost options
Navigating to Model Cost Configuration Interface

Navigating to Model Cost Configuration Interface

TrueFoundry offers two simple ways to track costs:

​
1. Public Cost - Automatic Pricing

Interface showing how to enable public cost tracking for a model

Setting up public cost

Public cost uses pre-configured pricing based on the provider’s published rates:
  • Automatically populated cost per token
  • Always up-to-date with official provider rates
  • Available for most popular models

​
2. Private Cost - Custom Pricing

Interface showing how to configure custom pricing for a model

Setting up private cost

Private cost lets you set custom pricing for:
  • Models without public pricing
  • Custom pricing contracts
  • Fine-tuned models

​
Viewing Your Costs

Once set up, you can easily view and analyze your costs in the Metrics section. Go to AI Gateway > Metrics.
Overview of the metrics page showing total costs and usage trends

Metrics page overview

The Metrics page shows your total costs, usage trends, and provides interactive filters to analyze your spending patterns.

​
Cost Breakdowns

View your costs from different perspectives with a single click:
Table showing cost breakdown by individual users

Cost by user

Table showing cost breakdown by individual models

Cost by model

Table showing cost breakdown by team

Cost by team

Each view helps you understand different aspects of your AI usage:
  • User view: Identify high-usage individuals
  • Model view: See which models cost the most
  • Team view: Track department or project spending

​
Exporting Cost Data

Interface showing how to download raw cost and usage data

Downloading cost data

Need to analyze your data further? Easily export it:
  1. Go to the Metrics section
  2. Click on the 3 dots button and then click on Download Raw Data
  3. Choose the fields you want to groupBy the data

​
Custom Grouping Options

You can customize how data is grouped in your exports. Simply select the fields you want to group by, such as username, model_name, or teams, to get exactly the data organization you need for your analysis.
Screenshot showing groupBy options for username, model_name, and teams

Custom grouping options

​
Frequently Asked Questions

Yes—fully configurable.Learn more: Rate Limiting
Yes—define budgets at multiple levels.Learn more: Budget Limiting
Cost attribution per user, team, provider, and model.Learn more: Cost Tracking
⌘I