Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
Severe memory leaks on Amazon AWS Linux platform #2646
PyMC3 3.2 and 3.1, Python 3.5.2, Theano 0.9.0, Ubuntu 16.04
Tried running the notebook at https://github.com/twiecki/WhileMyMCMCGentlySamples/blob/master/content/downloads/notebooks/random_walk_deep_net.ipynb
on an AWS Ubuntu instance. The python process allocated about 100MB of memory per second; allocated memory kept growing until the machine was effectively dead from memory swapping. The notebook exhausted memory on 61GB, 122GB, and 244GB instances. I also saw similar behavior on Amazon Linux but primarily investigated on Ubuntu. I tried the HDF5 backend and it did not make a difference.
The same setup worked fine on an AWS Windows instance.