TrueFoundry AI Gateway allows you to control which requests are logged.

​
Controlling Request Logging

​
Using HTTP Headers

To enable logging for a specific request, include the X-TFY-METADATA header: 
{
  "tfy_log_request": true
}
To disable logging for a specific request, set: 
{
  "tfy_log_request": false
}

​
Using Environment Variables

Environment variable configuration is only available when running a self-hosted instance of TrueFoundry AI Gateway
You can also control logging behavior globally by setting the REQUEST_LOGGING_MODE environment variable in the AI Gateway:
ModeDescription
HEADER_CONTROLLEDLogging depends on the tfy_log_request value in the X-TFY-METADATA header. If the header is absent or set to true, logging will occur. If set to false, no logging will happen.
ALWAYSAll requests are logged regardless of the tfy_log_request value.
NEVERNo requests are logged regardless of the tfy_log_request value.

​
Code Example

from openai import OpenAI

BASE_URL = "https://{controlPlaneUrl}/api/llm"
API_KEY = "your-truefoundry-api-key"

client = OpenAI(
    api_key=API_KEY,
    base_url=BASE_URL,
    default_headers={
        "X-TFY-METADATA": '{"tfy_log_request":"true"}'
    }
)