Experiment with the network

[patricksttan]

To find out what combination of architecture and parameters work best for the network, we should first have less variation in the results if we run the algorithm multiple times.

Tasks

• A fixed train test split (Koen is working on this see issue Add random seed for the train test split #44)
• Try if using https://keras.io/callbacks/#reducelronplateau smooths the curve at the end.

When the results are almost the same every run. Then we can easier compare the results.
We can try the following.

• Use weight decay
• Add dropout.
• See if more layers changes results. For example: replace pool layer with conv layer, or add another 1by1 conv at the end of the network.