Run out of memory [Only CPU Training ]

[shichaog]

Hi, Thanks for sharing this great project.
I training by follow command only by CPU on Ubuntu18 (no GPU).

python train_moglow.py 'hparams/style_gestures.json' trinity

My question is, 96GB memory run out. Training process will killed by OS. It seems memory leak happed during training process, Could help verify, Thanks!

[shichaog]

I think it's because of using LSTM op.

refer to:
LSTMs leak memory in CPU PyTorch 1.5.1, 1.6, and 1.7 on Linux
#41486

[shichaog]

I update pytorch and change LSTMs to GRU in style_gestures.json. OOM problem fixed!
pip install torch==1.7.0+cpu torchvision==0.8.1+cpu torchaudio==0.7.0 -f https://download.pytorch.org/whl/torch_stable.html