Skip to content

feat(cli): add eval compare bias correction flag#375

Merged
blainekasten merged 1 commit into
nextfrom
cursor/sdk-cli-parameter-changes-de43
May 20, 2026
Merged

feat(cli): add eval compare bias correction flag#375
blainekasten merged 1 commit into
nextfrom
cursor/sdk-cli-parameter-changes-de43

Conversation

@cursor
Copy link
Copy Markdown
Contributor

@cursor cursor Bot commented May 20, 2026

Summary

  • Adds --disable-position-bias-correction to tg evals create for compare evals.
  • Passes disable_position_bias_correction through to the eval create SDK request body.
  • Updates the compare eval help example and adds CLI coverage for the emitted request payload.

Test plan

  • python3 -m pytest tests/cli/test_evals.py -n 0

PR routing

  • Target branch: next (do not target main)
  • Requested reviewers: @blainekasten, @stainless-app[bot]
  • Incoming SDK commit: 27e6c2d
Open in Web View Automation 

@blainekasten blainekasten changed the base branch from main to next May 20, 2026 16:50
@blainekasten blainekasten self-requested a review May 20, 2026 16:50
Co-authored-by: Blaine Kasten <blainekasten@gmail.com>
@blainekasten
Copy link
Copy Markdown
Contributor

@cursoragent rebase on next then make sure to fix lint errors

@cursor
Copy link
Copy Markdown
Contributor Author

cursor Bot commented May 20, 2026

Done.

  • Rebasing onto origin/next completed cleanly.
  • Pushed rebased branch cursor/sdk-cli-parameter-changes-de43.
  • Updated PR target/base to next.
  • No lint code fixes were needed after rebase.

Verified:

./scripts/lint
uv run ruff format --check
uv run pytest tests/cli/test_evals.py -n 0

All passed locally.

GitHub check status at last poll:

  • lint: pass
  • build: pass
  • test-integration / test-others: still pending on the push run

Heads up: this cloud env was missing uv, so I installed it and synced deps. For future agents, env setup prompt could be:

Install uv in the Cursor Cloud environment and run uv sync --all-extras for togethercomputer/together-py so lint/test commands work out of the box.

Open in Web Open in Cursor 

@cursor cursor Bot force-pushed the cursor/sdk-cli-parameter-changes-de43 branch from 8e2cb46 to 5abd796 Compare May 20, 2026 17:25
@blainekasten blainekasten marked this pull request as ready for review May 20, 2026 17:35
@blainekasten blainekasten requested a review from jli-together May 20, 2026 17:35
@blainekasten blainekasten merged commit ac8482e into next May 20, 2026
9 checks passed
@stainless-app stainless-app Bot mentioned this pull request May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants