Skip to content

feat(evals): Add run mode to API payload#249

Merged
Ayush8923 merged 1 commit into
mainfrom
fix/added-run-mode-strictly
Jul 17, 2026
Merged

feat(evals): Add run mode to API payload#249
Ayush8923 merged 1 commit into
mainfrom
fix/added-run-mode-strictly

Conversation

@Ayush8923

@Ayush8923 Ayush8923 commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Previously, the backend default run_mode was batch, so the frontend didn’t send run_mode explicitly. We only sent run_mode=fast when overriding the default behavior.
  • Now that the backend default has changed to fast,batch runs will no longer work unless the frontend explicitly sends run_mode=batch. This PR updates the frontend to send the appropriate run_mode when triggering batch evaluations.

Checklist

Before submitting a pull request, please ensure that you mark these task.

  • Ran npm run dev and npm run build in the repository root and test.
  • If you've fixed a bug or added code that is tested

Summary by CodeRabbit

  • Bug Fixes
    • Evaluation runs now consistently use the selected run mode, including batch evaluations.
    • Improved reliability by explicitly communicating the run mode for every evaluation request.

@coderabbitai

coderabbitai Bot commented Jul 17, 2026

Copy link
Copy Markdown

Review Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 6db6e69b-cbd5-4b16-9423-0c980ffaba49

📥 Commits

Reviewing files that changed from the base of the PR and between 2458d95 and 046baaf.

📒 Files selected for processing (1)
  • app/(main)/evaluations/page.tsx

📝 Walkthrough

Walkthrough

The evaluation submission payload now always includes run_mode, set to fast for fast runs and batch otherwise.

Changes

Evaluation run mode

Layer / File(s) Summary
Explicit evaluation run mode
app/(main)/evaluations/page.tsx
handleRunEvaluation always includes run_mode in the POST payload, selecting fast or batch from runMode.

Estimated code review effort: 2 (Simple) | ~5 minutes

Possibly related PRs

Suggested reviewers: vprashrex

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/added-run-mode-strictly

Warning

There were issues while running some tools. Please review the errors and either fix the tool's configuration or disable the tool if it's a critical failure.

🔧 ESLint

If the error stems from missing dependencies, add them to the package.json file. For unrecoverable errors (e.g., due to private dependencies), disable the tool in the CodeRabbit configuration.

ESLint install timed out. The project may have too many dependencies for the sandbox.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions github-actions Bot changed the title fix(evlas): added the run mode in the evals run api payload feat(evals): Add run mode to API payload Jul 17, 2026
@Ayush8923 Ayush8923 self-assigned this Jul 17, 2026
@Ayush8923
Ayush8923 requested a review from vprashrex July 17, 2026 12:31
@Ayush8923
Ayush8923 merged commit d030bff into main Jul 17, 2026
2 of 3 checks passed
@Ayush8923
Ayush8923 deleted the fix/added-run-mode-strictly branch July 17, 2026 12:35
@github-actions

Copy link
Copy Markdown

🎉 This PR is included in version 0.4.0-main.1 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants