Severe mode collapse

[IvonaTau]

Hi all,

I was training the model on birds dataset as well as my own data and very soon in training for both datasets (e.g from epoch 5) I start to see some ugly mode collapse that continues till epoch 100 and beyond.

Example from my data (dresses):

Epoch 3:

Epoch 5:

Epoch 23:

Epoch 97:

Do you have any ideas how to improve the training?

[woozzu]

@IvonaTau Can you double check your data such as range, preprocessing, etc?