Training time using libri2mix

[spikeeSakshu]

Hey,

Actually I was trying to train the svoice model using the libri2mix data (sample_rate = 16000) and total samples present are around 13900 on a multi-gpu (4xK80) setup using ddp=1. But the training time for each epoch is fairly high over 6hours per epoch. So just wanted to check in is it expected or something is going wrong here.

Thank you.

[adiyoss]

Hi @spikeeSakshu,
It depends on the segment size and stride you use in the config file.
You can try to use bigger strides / smaller segments.
Generally speaking you can look at the runtime per sample and not per epoch as the number of examples per epoch can vary.