Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 8 additions & 8 deletions .speakeasy/gen.lock
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
lockVersion: 2.0.0
id: c75567cf-9def-4617-8ae7-65af6f367b68
management:
docChecksum: 48cd936770458449cc844b569a22f7e8
docChecksum: 2708188f6b0d7f57e65458a739069779
docVersion: 2.0.0
speakeasyVersion: 1.631.5
generationVersion: 2.716.16
releaseVersion: 1.2.1
configChecksum: cc51cd8283da5c8db2c1071ed0b07050
speakeasyVersion: 1.635.1
generationVersion: 2.722.2
releaseVersion: 1.3.0
configChecksum: bcf5568c877247dd91d99325a08aa512
features:
python:
additionalDependencies: 1.0.0
additionalProperties: 1.0.1
constsAndDefaults: 1.0.5
core: 5.22.0
core: 5.22.1
customCodeRegions: 0.1.1
defaultEnabledRetries: 0.2.0
devContainers: 3.0.0
Expand All @@ -32,7 +32,7 @@ features:
retries: 3.0.2
sdkHooks: 1.1.0
serverEvents: 1.0.10
unions: 3.0.5
unions: 3.1.0
generatedFiles:
- .devcontainer/README.md
- .devcontainer/devcontainer.json
Expand Down Expand Up @@ -861,7 +861,7 @@ examples:
path:
span_id: "77b258a2-45c1-4b87-a50c-9116bc8ed1d6"
requestBody:
application/json: {"name": "my span", "start_time": "2025-10-01T12:35:05.695370Z", "type": "email_tool", "end_time": "2025-10-01T12:35:05.695523Z", "input": "Hello, world!", "output": "Hello, world!", "error": "Exception: This is an error message", "meta": {"key": "value"}, "score": 10}
application/json: {"name": "my span", "start_time": "2025-10-06T16:05:03.988919Z", "type": "email_tool", "end_time": "2025-10-06T16:05:03.989013Z", "input": "Hello, world!", "output": "Hello, world!", "error": "Exception: This is an error message", "meta": {"key": "value"}, "score": 10}
responses:
"200":
application/json: {"name": "my span", "start_time": "2024-03-20T10:00:00+00:00", "id": "84d9ffc8-336c-4953-b92f-fe05d5405951", "trace_id": "123e4567-e89b-12d3-a456-426614174000", "parent_id": "123e4567-e89b-12d3-a456-426614174000", "type": "email_tool", "end_time": "2024-03-20T10:00:10+00:00", "input": "Hello, world!", "output": "Hello, world!", "error": "Exception: This is an error message", "meta": {"key": "value"}, "score": 10}
Expand Down
2 changes: 1 addition & 1 deletion .speakeasy/gen.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ generation:
generateNewTests: false
skipResponseBodyAssertions: false
python:
version: 1.2.1
version: 1.3.0
additionalDependencies:
dev: {}
main: {}
Expand Down
12 changes: 6 additions & 6 deletions .speakeasy/workflow.lock
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
speakeasyVersion: 1.631.5
speakeasyVersion: 1.635.1
sources:
FastAPI:
sourceNamespace: fast-api
sourceRevisionDigest: sha256:81dd3d0af66c49115b4f76073faf523af37677ff88fccf1a327c99b750dc6c53
sourceBlobDigest: sha256:4e8ab6e2a7edd16da947b6704ba60550f741772b0726330ac903c9d68d2148ef
sourceRevisionDigest: sha256:ff0cd89b7ab617d8c619b615017f9711be1be2578358b9670994d82fc4204a3b
sourceBlobDigest: sha256:9916f8da9a98f5bca1f009c69d20e12551da49abb560ff86e194cbd44817a2f6
tags:
- latest
- main
Expand All @@ -12,10 +12,10 @@ targets:
opper:
source: FastAPI
sourceNamespace: fast-api
sourceRevisionDigest: sha256:81dd3d0af66c49115b4f76073faf523af37677ff88fccf1a327c99b750dc6c53
sourceBlobDigest: sha256:4e8ab6e2a7edd16da947b6704ba60550f741772b0726330ac903c9d68d2148ef
sourceRevisionDigest: sha256:ff0cd89b7ab617d8c619b615017f9711be1be2578358b9670994d82fc4204a3b
sourceBlobDigest: sha256:9916f8da9a98f5bca1f009c69d20e12551da49abb560ff86e194cbd44817a2f6
codeSamplesNamespace: fast-api-python-code-samples
codeSamplesRevisionDigest: sha256:0d47d70e4f589bab6a2120d7d48b5efff92296a67214f52fc3961f7014322a63
codeSamplesRevisionDigest: sha256:e532b01f440cf513db80c3a9adb0a8fd613bf977cc55ac404e535dd92faab776
workflow:
workflowVersion: 1.0.0
speakeasyVersion: latest
Expand Down
12 changes: 6 additions & 6 deletions docs/models/evaluationconfig.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,16 +4,16 @@ Configuration for evaluation features stored under 'beta.evaluation'.

- enabled: master switch
- scorers: which evaluators to run. Accepts:
- string: "base" | "rubrics"
- string: "base" | "rubrics" | "toxicity" | "hallucination" | "qa"
- dict: { "rubrics": RubricDefinition-like payload }
- list[str | dict]
"base" is the default scorer.


## Fields

| Field | Type | Required | Description |
| ---------------------------------------------------------------- | ---------------------------------------------------------------- | ---------------------------------------------------------------- | ---------------------------------------------------------------- |
| `enabled` | *Optional[bool]* | :heavy_minus_sign: | Enable evaluation features (base or rubrics). |
| `scorers` | [Optional[models.ScorersUnion2]](../models/scorersunion2.md) | :heavy_minus_sign: | Evaluation scorers to run: 'base', 'rubrics', or a list of them. |
| `__pydantic_extra__` | Dict[str, *Any*] | :heavy_minus_sign: | N/A |
| Field | Type | Required | Description |
| -------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------- |
| `enabled` | *Optional[bool]* | :heavy_minus_sign: | Enable evaluation features (base or rubrics). |
| `scorers` | [Optional[models.ScorersUnion2]](../models/scorersunion2.md) | :heavy_minus_sign: | Evaluation scorers to run: 'base', 'rubrics', 'toxicity', 'hallucination', 'qa', 'agent_tool_selection', 'regex', 'max_length', or a list of them. |
| `__pydantic_extra__` | Dict[str, *Any*] | :heavy_minus_sign: | N/A |
Loading