You can optimize hyperparameters by:
allennlp tune \
imdb_optuna.jsonnet \
hparams.json \
--serialization-dir result \
--study-name test
allennlp best-params \
--study-name test
allennlp retrain \
imdb_optuna.jsonnet \
--serialization-dir retrain_result \
--study-name test