Uninitialize a torch network

I have some code which loads a torch model using lutorpy, every initialization consumes GPU memory around 250-300mb. Is there a way to free this memory?

As I tried to dereference from this initialized model variable and run garbage collector in python, and that didn't help.

Thanks.