API reference

API reference · API

List test suites

GET/v1/evalsAPI key

The account's suites. Read scope on /v1, the session cookie on /api/suites. Suites, their runs and the models' answers are the account's own: exported, erased, never public.

Answer 200

The suites.

Fields of the 200 answer
FieldTypeWhat it is
object"list"
dataarray of EvalSuite
data[].idstring
data[].object"eval"
data[].namestring
data[].pass_thresholdnumber
data[].revisionintegerMoves whenever the cases change; evidence from another revision is not routed on.
data[].case_countinteger
data[].route_modelstringThe model id that routes on this suite: antimatter/auto:suite/<id>.
data[].scheduleobject or null
data[].schedule.weeklyboolean
data[].schedule.budget_microsinteger
data[].schedule.last_checked_atinteger or null
data[].schedule.paid_bystringkey: each weekly run is the request of the key that last saved the suite. account: the dashboard saved it, and the personal account pays. One of "key", "account".
data[].schedule.stoppedstring or nullWhy the schedule stopped (the key that pays for it was revoked, expired or lost the chat scope). Saving the suite again resumes it.
data[].created_atinteger
data[].updated_atinteger

Errors

  • 401OpenAI shaped error.

Every error answers in one shape, with its type, code and the field it names. The whole list is in the docs' Errors section.

Antimatter