Batch
Get Batch Output
Get Started
Developer Guide
- Providers
- Code Integration
Configure Gateway
- Access Control
- Rate Limiting
- Load Balancing
- Fallback
- Guardrails
Observability
Deployment
Embeddings
Rerank
Responses
Moderations
Batch
Get Batch Output
Get output of a specific batch process
GET
/
batches
/
{id}
/
output
curl --request GET \
--url https://{controlPlaneURL}/api/llm/api/inference/openai/batches/{id}/output \
--header 'Authorization: Bearer <token>'
[
{
"id": "<string>",
"custom_id": "<string>",
"response": {
"status_code": 123,
"request_id": "<string>",
"body": {
"id": "<string>",
"object": "<string>",
"created": 123,
"model": "<string>",
"choices": [
{
"index": 123,
"message": {
"role": "<string>",
"content": "<string>",
"refusal": "<any>",
"annotations": [
"<any>"
]
},
"logprobs": "<any>",
"finish_reason": "<string>"
}
],
"usage": {
"prompt_tokens": 123,
"completion_tokens": 123,
"total_tokens": 123,
"prompt_tokens_details": {
"cached_tokens": 123,
"audio_tokens": 123
},
"completion_tokens_details": {
"reasoning_tokens": 123,
"audio_tokens": 123,
"accepted_prediction_tokens": 123,
"rejected_prediction_tokens": 123
}
},
"service_tier": "<string>",
"system_fingerprint": "<any>"
},
"error": "<any>"
},
"error": "<any>"
}
]
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Path Parameters
Batch Id
Response
200
application/json
Batch output retrieved successfully
The response is of type object[]
.
Was this page helpful?
curl --request GET \
--url https://{controlPlaneURL}/api/llm/api/inference/openai/batches/{id}/output \
--header 'Authorization: Bearer <token>'
[
{
"id": "<string>",
"custom_id": "<string>",
"response": {
"status_code": 123,
"request_id": "<string>",
"body": {
"id": "<string>",
"object": "<string>",
"created": 123,
"model": "<string>",
"choices": [
{
"index": 123,
"message": {
"role": "<string>",
"content": "<string>",
"refusal": "<any>",
"annotations": [
"<any>"
]
},
"logprobs": "<any>",
"finish_reason": "<string>"
}
],
"usage": {
"prompt_tokens": 123,
"completion_tokens": 123,
"total_tokens": 123,
"prompt_tokens_details": {
"cached_tokens": 123,
"audio_tokens": 123
},
"completion_tokens_details": {
"reasoning_tokens": 123,
"audio_tokens": 123,
"accepted_prediction_tokens": 123,
"rejected_prediction_tokens": 123
}
},
"service_tier": "<string>",
"system_fingerprint": "<any>"
},
"error": "<any>"
},
"error": "<any>"
}
]