Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multiple objectives hyperparameter tuning with lexicographic preference #752

Merged
merged 34 commits into from
Oct 19, 2022
Merged

Multiple objectives hyperparameter tuning with lexicographic preference #752

merged 34 commits into from
Oct 19, 2022

Conversation

Anonymous-submission-repo
Copy link
Contributor

@Anonymous-submission-repo Anonymous-submission-repo commented Oct 9, 2022 •
edited

Why are these changes needed?

This PR is to make FLAML support multiple objective optimizations with lexicographic preference across different objectives.
Currently, it is an extension to tune which provides users with a flexible way to customize their preferences.

Related issue number

Checks

TODO

@qingyun-wu qingyun-wu marked this pull request as draft October 10, 2022 00:44
@Anonymous-submission-repo Anonymous-submission-repo changed the title [Draft] Multiple objectives hyperparameter tuning with lexicographic preference Multiple objectives hyperparameter tuning with lexicographic preference Oct 10, 2022
@Anonymous-submission-repo Anonymous-submission-repo marked this pull request as ready for review October 10, 2022 02:30
@Anonymous-submission-repo
Copy link
Contributor Author

@microsoft-github-policy-service agree

@Anonymous-submission-repo
Copy link
Contributor Author

@microsoft-github-policy-service agree

sonichi
sonichi reviewed Oct 11, 2022
View reviewed changes
Copy link
Collaborator

@sonichi sonichi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please sign the agreement and fill "why is this change needed".

website/docs/Use-Cases/Tune-User-Defined-Function.md Show resolved Hide resolved
website/docs/Use-Cases/Tune-User-Defined-Function.md Outdated Show resolved Hide resolved
website/docs/Use-Cases/Tune-User-Defined-Function.md Outdated Show resolved Hide resolved
website/docs/Use-Cases/Tune-User-Defined-Function.md Outdated Show resolved Hide resolved
test/tune/test_lexiflow.py Outdated Show resolved Hide resolved
flaml/tune/analysis.py Outdated Show resolved Hide resolved
flaml/tune/analysis.py Outdated Show resolved Hide resolved
flaml/automl.py Outdated Show resolved Hide resolved
flaml/automl.py Outdated Show resolved Hide resolved
flaml/automl.py Outdated Show resolved Hide resolved
@Anonymous-submission-repo Anonymous-submission-repo requested review from sonichi and removed request for qingyun-wu October 12, 2022 14:10
sonichi
sonichi reviewed Oct 12, 2022
View reviewed changes
flaml/automl.py Outdated Show resolved Hide resolved
flaml/tune/searcher/blendsearch.py Outdated Show resolved Hide resolved
flaml/tune/tune.py Outdated Show resolved Hide resolved
test/automl/test_lexiflow.py Outdated Show resolved Hide resolved
test/automl/test_lexiflow.py Outdated Show resolved Hide resolved
flaml/tune/tune.py Outdated Show resolved Hide resolved
flaml/tune/tune.py Show resolved Hide resolved
flaml/tune/tune.py Show resolved Hide resolved
flaml/tune/tune.py Show resolved Hide resolved
flaml/tune/tune.py Outdated Show resolved Hide resolved
@liususan091219 liususan091219 mentioned this pull request Oct 12, 2022
Merged
4 tasks
qingyun-wu
qingyun-wu reviewed Oct 13, 2022
View reviewed changes
flaml/automl.py Outdated Show resolved Hide resolved
@Anonymous-submission-repo @sonichi
Update flaml/tune/searcher/search_thread.py
7f6e7b3 
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
@Anonymous-submission-repo @qingyun-wu
Update flaml/automl.py
2334a9c 
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
@sonichi
Merge branch 'main' into LexiFlow
cafb671
qingyun-wu
qingyun-wu reviewed Oct 14, 2022
View reviewed changes
flaml/automl.py Outdated Show resolved Hide resolved
flaml/automl.py Outdated Show resolved Hide resolved
flaml/tune/searcher/flow2.py Outdated Show resolved Hide resolved
flaml/tune/tune.py Outdated Show resolved Hide resolved
@Anonymous-submission-repo @sonichi
Update test/tune/test_lexiflow.py
6df7782 
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
@Anonymous-submission-repo @sonichi
Update flaml/tune/searcher/flow2.py
608c6ba 
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
@Anonymous-submission-repo @sonichi
Update flaml/tune/searcher/flow2.py
10d36dc 
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
@Anonymous-submission-repo
update
44883f7
@Anonymous-submission-repo
clean up
2daaa4c
@Anonymous-submission-repo Anonymous-submission-repo mentioned this pull request Oct 15, 2022
Closed
2 tasks
@Anonymous-submission-repo
Copy link
Contributor Author

Could you fill "Why are these changes needed" section in the PR description?
Could you check the code coverage and make sure it doesn't drop?
Could you add an issue about adding a performance test?

Sure

sonichi
sonichi reviewed Oct 16, 2022
View reviewed changes
flaml/tune/searcher/blendsearch.py Outdated Show resolved Hide resolved
flaml/tune/searcher/flow2.py Outdated Show resolved Hide resolved
flaml/tune/searcher/flow2.py Outdated Show resolved Hide resolved
flaml/tune/searcher/flow2.py Show resolved Hide resolved
flaml/tune/tune.py Outdated Show resolved Hide resolved
flaml/tune/tune.py Outdated Show resolved Hide resolved
website/docs/Use-Cases/Tune-User-Defined-Function.md Outdated Show resolved Hide resolved
website/docs/Use-Cases/Tune-User-Defined-Function.md Outdated Show resolved Hide resolved
website/docs/Use-Cases/Tune-User-Defined-Function.md Outdated Show resolved Hide resolved
qingyun-wu
qingyun-wu approved these changes Oct 18, 2022
View reviewed changes
flaml/tune/tune.py Show resolved Hide resolved
test/automl/test_lexiflow.py Outdated Show resolved Hide resolved
sonichi
sonichi reviewed Oct 18, 2022
View reviewed changes
Copy link
Collaborator

@sonichi sonichi left a comment •
edited

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"to release"? Could you bump the version to 1.1.0?

@skzhang1 skzhang1 merged commit 58227a9 into microsoft:main Oct 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sonichi sonichi sonichi approved these changes

@qingyun-wu qingyun-wu qingyun-wu approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@Anonymous-submission-repo @sonichi @qingyun-wu @skzhang1