Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated hyperparameter optimization #18

Open
suhacker1 opened this issue Sep 18, 2020 · 0 comments
Open

Automated hyperparameter optimization #18

suhacker1 opened this issue Sep 18, 2020 · 0 comments
Labels
backend Backend improvements; may not directly impact user experience help wanted Extra attention is needed needs validation Some validation is required to document the solution

Comments

@suhacker1
Copy link
Collaborator

suhacker1 commented Sep 18, 2020

Is your feature request related to a problem? Please describe.
Presently, users have to manually pick different hyperparameters for training a substitute model and other phases of each attack. However, constructing an effective attack often requires these hyperparameters to be optimized.

Describe the solution you'd like.
Optuna is a commonly used library to facilitate automated hyperparameter optimized. Different techniques should be tested in order to determine what the best optimization strategy is for PrivacyRaven.

Describe alternatives you've considered.
Other hyperparameter libraries can be used.

Detail any additional context.
The PyTorch Lightning parameters already contained within PrivacyRaven can be changed if needed. Additionally, the hyperparameters are stored within a dictionary, but can be move to an enum or other suitable solution.

@suhacker1 suhacker1 added backend Backend improvements; may not directly impact user experience help wanted Extra attention is needed needs validation Some validation is required to document the solution labels Sep 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Backend improvements; may not directly impact user experience help wanted Extra attention is needed needs validation Some validation is required to document the solution
Projects
None yet
Development

No branches or pull requests

1 participant