Skip to content

Document 250 KB per-span field size limit for LLM-as-a-judge evaluations #35773

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gsvigruha merged 2 commits into from
Apr 6, 2026
Merged

Document 250 KB per-span field size limit for LLM-as-a-judge evaluations #35773

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
7adc161
Document 250 KB per-span field size limit for LLM-as-a-judge evaluations
gsvigruha Apr 6, 2026
270302b
Merge branch 'master' into gergely.svigruha/document-eval-data-size
estherk15 Apr 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ...nt/en/llm_observability/evaluations/custom_llm_as_a_judge_evaluations/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -277,6 +277,8 @@ Assessment Criteria is not currently available for JSON evaluations.

### Define the evaluation scope: Filtering and sampling

<div class="alert alert-info">Span fields used in evaluations are limited to 250 KB each. Fields exceeding this size are truncated before being sent to the LLM judge.</div>

Under **Evaluation Scope**, define where and how your evaluation runs. This helps control coverage (which spans are included) and cost (how many spans are sampled).
- **Application**: Select the application you want to evaluate.
- **Evaluate On**: Choose one of the following:
Expand Down
Loading