An issue about vq loss and commitment loss

[Haoang97]

Hi @nadavbh12, thanks for your wonderful reproduction!

I met an issue about the vq_train loss and commitment_train loss.

When running VQVAE on both CIFAR10 and ImageNet, I found that the test mse loss would drop, but the vq loss and the commitment loss would clearly increasae at an early stage and then reach a covergence state.

If you had also met this issue? Sincerely looking for your help!

[nadavbh12]

Hi,
I'm afraid I haven't ran this code in a few years, so I honstly don't remember...