Get Started
Developer Guide
- Providers
- Code Integration
Configure Gateway
- Access Control
- Rate Limiting
- Load Balancing
- Fallback
- Guardrails
Observability
Deployment
Embeddings
Rerank
Responses
Moderations
Batch
List batches
List all batches
GET
/
batches
curl --request GET \
--url https://{controlPlaneURL}/api/llm/api/inference/openai/batches \
--header 'Authorization: Bearer <token>'
{
"object": "<string>",
"data": [
{
"id": "<string>",
"object": "<string>",
"endpoint": "<string>",
"errors": {
"object": "<string>",
"data": [
{
"code": "<string>",
"message": "<string>",
"param": "<string>",
"line": 123
}
]
},
"input_file_id": "<string>",
"completion_window": "<string>",
"status": "<string>",
"output_file_id": "<string>",
"error_file_id": "<string>",
"created_at": 123,
"in_progress_at": 123,
"expires_at": 123,
"finalizing_at": 123,
"completed_at": 123,
"failed_at": 123,
"expired_at": 123,
"cancelling_at": 123,
"cancelled_at": 123,
"request_counts": {
"total": 123,
"completed": 123,
"failed": 123
},
"metadata": "<any>"
}
],
"first_id": "<string>",
"last_id": "<string>",
"has_more": true
}
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Response
200 - application/json
Batches retrieved successfully
The response is of type object
.
Was this page helpful?
curl --request GET \
--url https://{controlPlaneURL}/api/llm/api/inference/openai/batches \
--header 'Authorization: Bearer <token>'
{
"object": "<string>",
"data": [
{
"id": "<string>",
"object": "<string>",
"endpoint": "<string>",
"errors": {
"object": "<string>",
"data": [
{
"code": "<string>",
"message": "<string>",
"param": "<string>",
"line": 123
}
]
},
"input_file_id": "<string>",
"completion_window": "<string>",
"status": "<string>",
"output_file_id": "<string>",
"error_file_id": "<string>",
"created_at": 123,
"in_progress_at": 123,
"expires_at": 123,
"finalizing_at": 123,
"completed_at": 123,
"failed_at": 123,
"expired_at": 123,
"cancelling_at": 123,
"cancelled_at": 123,
"request_counts": {
"total": 123,
"completed": 123,
"failed": 123
},
"metadata": "<any>"
}
],
"first_id": "<string>",
"last_id": "<string>",
"has_more": true
}