API reference

API reference · API

A suite's runs

GET/v1/evals/{id}/runsAPI key

Newest first; ?limit= up to 100.

Parameters

Path and query parameters
FieldTypeWhat it is
id (path)requiredstringThe suite id (ev_...).
limit (query)integer

Answer 200

The runs.

Fields of the 200 answer
FieldTypeWhat it is
object"list"
dataarray of EvalRun
data[].idstring
data[].object"eval.run"
data[].suite_idstring
data[].statusstringOne of "queued", "running", "completed", "budget_exhausted", "cancelled".
data[].triggerstringOne of "manual", "scheduled".
data[].revisioninteger
data[].modelsarray of string
data[].case_countinteger
data[].budget_microsinteger
data[].spent_microsinteger
data[].reserved_microsintegerWorst cases held for cases in flight.
data[].progressobject
data[].progress.doneinteger
data[].progress.totalinteger
data[].created_atinteger
data[].started_atinteger or null
data[].finished_atinteger or null

Errors

  • 401OpenAI shaped error.
  • 404OpenAI shaped error.

Every error answers in one shape, with its type, code and the field it names. The whole list is in the docs' Errors section.

Antimatter