Tool Calling

Tool Calling

Tool calling in the TrueFoundry LLM Gateway enables language models to simulate interactions with external functions, enhancing their versatility and practical application.

Although the gateway does not directly execute calls to external tools, it allows you to describe the tool and simulate the call within the response. This simulation provides a detailed representation of the request and expected response, allowing developers to understand how the language model would interact with external systems.

Rate Limiting (coming soon)