TrueFoundry AI Gateway Architecture
User makes a request to the AI Gateway
Gateway validates the request
Gateway checks for budget-limiting and rate-limiting rules
Gateway selects the model based on the load-balancing rules
Router/Adapter translates the request to the appropriate model
Handle Response from the model
Log the request and response