run_output_items

Creates, updates, deletes, gets or lists a run_output_items resource.

Overview

Name	run_output_items
Type	Resource
Id	openai.evals.run_output_items

Fields

The following fields are returned by SELECT queries:

get

The evaluation run output item

Name	Datatype	Description
id	string	Unique identifier for the evaluation run output item.
datasource_item_id	integer	The identifier for the data source item.
eval_id	string	The identifier of the evaluation group.
run_id	string	The identifier of the evaluation run associated with this output item.
created_at	integer (unixtime)	Unix timestamp (in seconds) when the evaluation run was created.
datasource_item	object	Details of the input data source item.
object	string	The type of the object. Always "eval.run.output_item". (eval.run.output_item) (default: eval.run.output_item)
results	array	A list of grader results for this output item.
sample	object	A sample containing the input and output of the evaluation run.
status	string	The status of the evaluation run.

list

A list of output items for the evaluation run

Name	Datatype	Description
id	string	Unique identifier for the evaluation run output item.
datasource_item_id	integer	The identifier for the data source item.
eval_id	string	The identifier of the evaluation group.
run_id	string	The identifier of the evaluation run associated with this output item.
created_at	integer (unixtime)	Unix timestamp (in seconds) when the evaluation run was created.
datasource_item	object	Details of the input data source item.
object	string	The type of the object. Always "eval.run.output_item". (eval.run.output_item) (default: eval.run.output_item)
results	array	A list of grader results for this output item.
sample	object	A sample containing the input and output of the evaluation run.
status	string	The status of the evaluation run.

Methods

The following methods are available for this resource:

Name	Accessible by	Required Params	Optional Params	Description
get	select	eval_id, run_id, output_item_id	openai-organization, openai-project
list	select	eval_id, run_id	after, limit, status, order, openai-organization, openai-project

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

Name	Datatype	Description
eval_id	string	The ID of the evaluation to retrieve runs for.
output_item_id	string	The ID of the output item to retrieve.
run_id	string	The ID of the run to retrieve output items for.
after	string	Identifier for the last output item from the previous pagination request.
limit	integer	Number of output items to retrieve. Automatically applied from a SQL LIMIT clause - SELECT ... LIMIT 10 sends limit=10 on the wire. Setting it explicitly in a WHERE clause is not required.
openai-organization	string	Optionally scope the request to a specific organization (overrides the default associated with the API key). Addressable in SQL as openai_organization.
openai-project	string	Optionally scope the request to a specific project (overrides the default associated with the API key). Addressable in SQL as openai_project.
order	string	Sort order for output items by timestamp. Use asc for ascending order or desc for descending order. Defaults to asc.
status	string	Filter output items by status. Use failed to filter by failed output items or pass to filter by passed output items.

SELECT examples

get

The evaluation run output item

SELECT
id,
datasource_item_id,
eval_id,
run_id,
created_at,
datasource_item,
object,
results,
sample,
status
FROM openai.evals.run_output_items
WHERE eval_id = '{{ eval_id }}' -- required
AND run_id = '{{ run_id }}' -- required
AND output_item_id = '{{ output_item_id }}' -- required
AND "openai-organization" = '{{ openai-organization }}'
AND "openai-project" = '{{ openai-project }}'
;

list

A list of output items for the evaluation run

SELECT
id,
datasource_item_id,
eval_id,
run_id,
created_at,
datasource_item,
object,
results,
sample,
status
FROM openai.evals.run_output_items
WHERE eval_id = '{{ eval_id }}' -- required
AND run_id = '{{ run_id }}' -- required
AND after = '{{ after }}'
AND status = '{{ status }}'
AND "order" = '{{ order }}'
AND "openai-organization" = '{{ openai-organization }}'
AND "openai-project" = '{{ openai-project }}'
;