GNU parallel to run zrc2019 training in multiple cores

[jubenjum]

I made a mod in the run.sh script and include a new aud_gnu_parallel.sh script that uses gnu parallel to make the training in multiple cores. It may interesting to speeding up the training in single computer with multiple available cores.

Juan

[lucasondel]

Hi Juan,

Thanks a lot for your PR ! I think it's a good strategy to use gnu parallel so everyone can run it.

I've tried to run it on some data and spotted 2 problems:

1. When you split the list of utterances, "split" may break the file in the middle of a line which make the script to failed for some utterances. You can fix it with

$ split ... -n $njobs ... -> $ split ... -n l/$njobs ...

2. So far the script just run 1 epoch, it would probably be better if the user specify the number of training epochs and the number of jobs.

Lucas

[jubenjum]

Hi Lucas,

I fixed the bug in the split function, and I changed the part that does the epochs. I also introduced a shuffle on the input data then each epoch will be a bit different.

Do you think that the decoding part can be parallelized?

Juan

[lucasondel]

Hi Juan,

Ok it works on my side. I'll merge the PR.

Regarding the parallel decoding. Shouldn't be too complicated to do. I can handle it next week.

Lucas

[lucasondel]

Parallel decoding is done and available on the master #70 (see steps/aud_decode_gnu_parallel.sh).

Lucas