Antimatter

POST/api/suites/{id}/runs/{runId}/cancelSigned in session

Chat scope. Nothing pending starts; a case in flight is graded and paid for as it would have been. Models graded on every case before the cancel still leave evidence.

Parameters

Path and query parameters
Field	Type	What it is
id (path)required	string	The suite id (ev_...).
runId (path)required	string	The run id (evrun_...).

Answer 200

The run.

Fields of the 200 answer
Field	Type	What it is
id	string
object	"eval.run"
suite_id	string
status	string	One of "queued", "running", "completed", "budget_exhausted", "cancelled".
trigger	string	One of "manual", "scheduled".
revision	integer
models	array of string
case_count	integer
budget_micros	integer
spent_micros	integer
reserved_micros	integer	Worst cases held for cases in flight.
progress	object
progress.done	integer
progress.total	integer
created_at	integer
started_at	integer or null
finished_at	integer or null
threshold	number
cheapest_passing	string or null	The cheapest model graded on every case at or over the threshold.
summary	array of object
summary[].model	string
summary[].pass_rate	number or null	Weighted share of graded cases passed.
summary[].passed	integer
summary[].failed	integer
summary[].errors	integer
summary[].skipped	integer
summary[].pending	integer
summary[].graded	integer
summary[].cases	integer
summary[].complete	boolean
summary[].cost_micros	integer
summary[].cost_per_case_micros	integer or null
summary[].median_latency_ms	integer or null
summary[].on_frontier	boolean	No other model is as cheap or cheaper and passes as much or more.
failures	array of object	At most 200, each with the model's output clipped to 4000 characters.
failure_count	integer

Errors

400OpenAI shaped error.
401OpenAI shaped error.
404OpenAI shaped error.

Every error answers in one shape, with its type, code and the field it names. The whole list is in the docs' Errors section.