Skip to content

Commit ef3868e

Browse files
Cancel api (#1180)
* Model Evals - Added New APIs * Added Model Evals List API
1 parent bf09ee5 commit ef3868e

2 files changed

Lines changed: 78 additions & 0 deletions

File tree

specification/resources/gen-ai/definitions.yml

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5538,6 +5538,20 @@ apiListModelEvaluationPresetsOutput:
55385538
type: object
55395539
apiListModelEvaluationRunsOutput:
55405540
properties:
5541+
available_candidate_types:
5542+
description: |-
5543+
Full set of candidate model source types the FE can offer in the
5544+
candidate-type filter UI.
5545+
items:
5546+
$ref: '#/apiCandidateModelSource'
5547+
type: array
5548+
available_statuses:
5549+
description: |-
5550+
Full set of statuses the FE can offer in the status filter UI. Returned
5551+
on every list call so clients never need to hardcode the enum values.
5552+
items:
5553+
$ref: '#/apiModelEvaluationRunStatus'
5554+
type: array
55415555
links:
55425556
$ref: '#/apiLinks'
55435557
meta:

specification/resources/gen-ai/genai_list_model_evaluation_runs.yml

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,70 @@ parameters:
3636
name: per_page
3737
schema:
3838
type: integer
39+
- description: Filter by one or more statuses. Empty means no status filter.
40+
example:
41+
- MODEL_EVALUATION_RUN_STATUS_UNSPECIFIED
42+
in: query
43+
name: statuses
44+
schema:
45+
items:
46+
enum:
47+
- MODEL_EVALUATION_RUN_STATUS_UNSPECIFIED
48+
- MODEL_EVALUATION_RUN_QUEUED
49+
- MODEL_EVALUATION_RUN_RUNNING_DATASET
50+
- MODEL_EVALUATION_RUN_EVALUATING_RESULTS
51+
- MODEL_EVALUATION_RUN_CANCELLING
52+
- MODEL_EVALUATION_RUN_CANCELLED
53+
- MODEL_EVALUATION_RUN_SUCCESSFUL
54+
- MODEL_EVALUATION_RUN_PARTIALLY_SUCCESSFUL
55+
- MODEL_EVALUATION_RUN_FAILED
56+
type: string
57+
type: array
58+
- description: |-
59+
Filter by one or more candidate model source types
60+
(serverless, dedicated, router). Empty means no candidate-type filter.
61+
example:
62+
- CANDIDATE_MODEL_SOURCE_SERVERLESS
63+
in: query
64+
name: candidate_types
65+
schema:
66+
items:
67+
enum:
68+
- CANDIDATE_MODEL_SOURCE_SERVERLESS
69+
- CANDIDATE_MODEL_SOURCE_DEDICATED
70+
- CANDIDATE_MODEL_SOURCE_ROUTER
71+
type: string
72+
type: array
73+
- description: |-
74+
Free-text search across the eval run name, candidate model name and
75+
dataset name (case-insensitive substring match). Empty means no search.
76+
example: example string
77+
in: query
78+
name: search
79+
schema:
80+
type: string
81+
- description: Field to sort by. Defaults to creation date when unspecified.
82+
example: MODEL_EVALUATION_RUN_SORT_FIELD_UNSPECIFIED
83+
in: query
84+
name: sort_by
85+
schema:
86+
default: MODEL_EVALUATION_RUN_SORT_FIELD_UNSPECIFIED
87+
enum:
88+
- MODEL_EVALUATION_RUN_SORT_FIELD_UNSPECIFIED
89+
- MODEL_EVALUATION_RUN_SORT_FIELD_CREATED_AT
90+
- MODEL_EVALUATION_RUN_SORT_FIELD_STATUS
91+
type: string
92+
- description: Sort direction. Defaults to descending when unspecified.
93+
example: SORT_DIRECTION_UNSPECIFIED
94+
in: query
95+
name: sort_direction
96+
schema:
97+
default: SORT_DIRECTION_UNSPECIFIED
98+
enum:
99+
- SORT_DIRECTION_UNSPECIFIED
100+
- SORT_DIRECTION_ASC
101+
- SORT_DIRECTION_DESC
102+
type: string
39103
responses:
40104
"200":
41105
content:

0 commit comments

Comments
 (0)