-
Notifications
You must be signed in to change notification settings - Fork 439
Training hidden_units of DNN with skflow #71
Comments
You can try using Otherwise - it's really just an experiments and trying to understand how it changes the quality of the model. There just basic rules of thumb (like start with the same number as original features and then go less and less: e.g. for 500 features you can use [500, 250, 100]). You also want to balance the number of examples you have versus a number of parameters. Usually, you want to have ~10 examples per parameter. |
Haha, thank you for giving this rule of thumb. I have to confess that there a lot "rule of thumb" presented in discussion in quora or stackoverflow or researchgate to construct hidden layers in DNN, but let me check with your rule. |
I think GridSearch in sklearn is similar with h2o.grid in h2o deep learning. However, the idea is you need to present all the possible |
There are other hyperparameter optimizers that actually take into account the values and accuracy of the model to pick next values (we use something like this in Google). |
Hope this helped! I'm closing this bug for now. |
Hello all
As I know, there are several ways to optimize DNN. I think the most important parameters for DNN should be
hidden_units
.Is it possible to somehow find best
hidden_units
automatically?The text was updated successfully, but these errors were encountered: