Training difficulties

[cbasavaraj]

Hi,

I am training on casia-clean + align, using IR_SE_50 backbone and ArcFace head. Somehow the network just isn't learning well. The loss is around 24 for the first few epochs, and even after stage 1 adjustment, it drops only to around 19.
I see during your training that the loss starts around 10. Anything I am doing wrong / missing?

Thanks

[ZhaoJ9014]

Hi,

I am training on casia-clean + align, using IR_SE_50 backbone and ArcFace head. Somehow the network just isn't learning well. The loss is around 24 for the first few epochs, and even after stage 1 adjustment, it drops only to around 19.
I see during your training that the loss starts around 10. Anything I am doing wrong / missing?

Thanks

Hi, thank you for your question. What you have done is correct. As you can see, the screenprint of training process in this repo is already after 10 epoches. The loss value of margin based function is usually larger than vanilla softmax.