Training loss suddenly decrease at the beginning of each epoch.

[Tebmer]

Hi,

I use the code in codes to train model. But I find a strange phenomenon that the loss suddenly decreases at the beginning of every epoch.

So, my question is that is this the same as your training curve? and why does it suddenly decrease at the beginning of every epoch? I thought about it for a long time, but I still can't figure it out. Thanks a lot!

[lsy641]

which version of code do you use?

Hi,

I use the code in codes to train model. But I find a strange phenomenon that the loss suddenly decreases at the beginning of every epoch.

So, my question is that is this the same as your training curve? and why does it suddenly decrease at the beginning of every epoch? I thought about it for a long time, but I still can't figure it out. Thanks a lot!

[Tebmer]

The first one, codes directory.

[Tebmer]

@lsy641 Hi, I use the first one version code, i.e. codes directory,

[lsy641]

Sorry, I didn't see the newest comment. I didn't notice a strange curve when training. BTW I fixed a bug in June 25. @Tebmer