Skip to content

feat(frontend): add 'New evaluation' button and setup modal to SDK Evals tab #3559

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
bekossy merged 1 commit into from
Jan 25, 2026
Merged

feat(frontend): add 'New evaluation' button and setup modal to SDK Evals tab #3559

bekossy merged 1 commit into from
Jan 25, 2026
+189 −6

Conversation

@mmabrouk
Copy link
Member

@mmabrouk mmabrouk commented Jan 23, 2026 •
edited by devin-ai-integration bot
Loading

Summary

  • Adds a "New evaluation" button to the SDK Evals tab (same position/style as auto/human/online tabs)
  • Clicking opens a SetupEvaluationModal — same layout as the Setup Tracing modal (EnhancedModal, custom header with close + action buttons, scrollable body)
  • Modal content: API key generation, pip install command, and a full Python evaluation code snippet
  • Header includes "Run in colab" and "Read the docs" links

Changes

File Change
SetupEvaluationModal/index.tsx New — Modal component reusing EnhancedModal, ApiKeyInput, and TracingCodeComponent
atoms/context.ts Enable createSupported for custom (SDK) evaluation kind
EvaluationRunsCreateButton.tsx Add "custom" to supported create types with SDK copy
EvaluationRunsTable/index.tsx Wire SetupEvaluationModal render for custom type
Open with Devin

@vercel
Copy link

vercel bot commented Jan 23, 2026 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Review Updated (UTC)
agenta-documentation Ready Ready Preview, Comment Jan 23, 2026 7:10pm

Request Review

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Jan 23, 2026
@mmabrouk mmabrouk requested review from ardaerzin and bekossy January 23, 2026 19:12
devin-ai-integration[bot]
devin-ai-integration bot reviewed Jan 23, 2026
View reviewed changes
Copy link

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 4 additional flags.

Open in Devin Review

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Jan 25, 2026
@bekossy bekossy merged commit 421ce06 into feat/widget-onboarding Jan 25, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@devin-ai-integration devin-ai-integration[bot] devin-ai-integration[bot] left review comments

@bekossy bekossy bekossy approved these changes

@ardaerzin ardaerzin Awaiting requested review from ardaerzin

Assignees

No one assigned

Labels

Frontend lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files. UI

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@mmabrouk @bekossy