Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[preferential] Change behavior of best_trials and remove mark_comparison_ready #596

Merged
merged 21 commits into from
Sep 7, 2023

Conversation

contramundum53
Copy link
Member

@contramundum53 contramundum53 commented Aug 31, 2023

Contributor License Agreement

This repository (optuna-dashboard) and Goptuna share common code.
This pull request may therefore be ported to Goptuna.
Make sure that you understand the consequences concerning licenses and check the box below if you accept the term before creating this pull request.

  • I agree this patch may be ported to Goptuna by other Goptuna contributors.

What does this implement/fix? Explain your changes.

Change the behavior of best_trials to "reported good at least once, not reported bad and not skipped".

Remove mark_comparison_ready since it is not necessary anymore.

Depends on #595.

@contramundum53
Copy link
Member Author

Followup: Change UI

@c-bata c-bata self-assigned this Sep 1, 2023
@codecov
Copy link

codecov bot commented Sep 4, 2023

Codecov Report

Merging #596 (f152ee1) into main (7b0dce7) will decrease coverage by 0.40%.
Report is 1 commits behind head on main.
The diff coverage is 37.03%.

@@            Coverage Diff             @@
##             main     #596      +/-   ##
==========================================
- Coverage   55.68%   55.28%   -0.40%     
==========================================
  Files          34       34              
  Lines        2094     2100       +6     
==========================================
- Hits         1166     1161       -5     
- Misses        928      939      +11     
Files Changed Coverage Δ
optuna_dashboard/preferential/samplers/gp.py 0.00% <0.00%> (ø)
optuna_dashboard/preferential/_system_attrs.py 77.08% <23.07%> (-20.29%) ⬇️
optuna_dashboard/preferential/_study.py 91.91% <53.84%> (-1.29%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@contramundum53 contramundum53 changed the title [preferential] Separate best_trials and active_trials [preferential] Change behavior of best_trials and remove mark_comparison_ready Sep 4, 2023
Copy link
Member

@c-bata c-bata left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@contramundum53 Thank you for your pull request! I left one comment.

optuna_dashboard/preferential/_study.py Show resolved Hide resolved
Copy link
Member

@c-bata c-bata left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a nit.

optuna_dashboard/preferential/_study.py Outdated Show resolved Hide resolved
Copy link
Member

@c-bata c-bata left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your pull request. I left some comments.

optuna_dashboard/ts/components/PreferentialTrials.tsx Outdated Show resolved Hide resolved
optuna_dashboard/preferential/_system_attrs.py Outdated Show resolved Hide resolved
optuna_dashboard/preferential/_study.py Outdated Show resolved Hide resolved
contramundum53 and others added 4 commits September 7, 2023 15:55
Co-authored-by: c-bata <c-bata@users.noreply.github.com>
Co-authored-by: c-bata <c-bata@users.noreply.github.com>
Co-authored-by: c-bata <c-bata@users.noreply.github.com>
Copy link
Member

@c-bata c-bata left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. @moririn2528 Could you take another look?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In 162 line,

isBestTrial={() => true}

This is written because all displayed trials are best. So could you change this one?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM except for the above nit.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your comment!
I fixed this issue, so I'll merge it myself.

@contramundum53 contramundum53 merged commit bffe7c4 into optuna:main Sep 7, 2023
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants