Skip to content

[core] Deflake test_task_metrics.py::test_pull_manager_stats - #63993

Merged
edoakes merged 5 commits into
ray-project:masterfrom
edoakes:eoakes/deflake-task-stats
Jun 10, 2026
Merged

[core] Deflake test_task_metrics.py::test_pull_manager_stats#63993
edoakes merged 5 commits into
ray-project:masterfrom
edoakes:eoakes/deflake-task-stats

Conversation

@edoakes

@edoakes edoakes commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator

Loosen task state condition to include SUBMITTED_TO_WORKER.

Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
@edoakes edoakes added the go add ONLY when ready to merge, run all tests label Jun 10, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to reduce flakiness in test_pull_manager_stats by counting both RUNNING and SUBMITTED_TO_WORKER states as running. Feedback includes a reminder to remove the temporary 50-trial parameterization before merging to avoid slow CI runs, and a suggestion to assert that only expected keys are present in stats since the length assertion was removed.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

Comment thread python/ray/tests/test_task_metrics.py Outdated
Comment thread python/ray/tests/test_task_metrics.py
@edoakes

edoakes commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator Author

Ran the test many times on repeat in CI, no failures across ~20 runs: https://buildkite.com/ray-project/premerge/builds/67941

Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
@edoakes edoakes changed the title [WIP][core] Deflake test_task_metrics.py::test_pull_manager_stats [core] Deflake test_task_metrics.py::test_pull_manager_stats Jun 10, 2026
@edoakes
edoakes marked this pull request as ready for review June 10, 2026 16:27
@edoakes
edoakes requested a review from a team as a code owner June 10, 2026 16:27
edoakes and others added 3 commits June 10, 2026 11:28
Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
@edoakes
edoakes merged commit bca3753 into ray-project:master Jun 10, 2026
5 of 6 checks passed
@ray-gardener ray-gardener Bot added the core Issues that should be addressed in Ray Core label Jun 10, 2026
limarkdcunha pushed a commit to limarkdcunha/ray that referenced this pull request Jun 30, 2026
…roject#63993)

Loosen task state condition to include `SUBMITTED_TO_WORKER`.

---------

Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Issues that should be addressed in Ray Core go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants