Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating video issue #52

Closed
DavidRees87 opened this issue Feb 4, 2022 · 7 comments
Closed

Creating video issue #52

DavidRees87 opened this issue Feb 4, 2022 · 7 comments

Comments

@DavidRees87
Copy link

When using the default set up I am able to create a video without any problem. The issue I am having is when locating the .pkl file in my GDrive. The GDrive is connected, the training is being saved there and I am able to resume training with no problem. However when I use the path to the .pkl file neither images or video can be created. Do you have any ideas why this may be happening and any solutions?

Thank you for any help you can give, I greatly appreciate it.

@woctezuma
Copy link

woctezuma commented Feb 5, 2022

Maybe try to copy the .pkl file from your Google Drive to your local session on Google Colab.

@xl-sr
Copy link
Contributor

xl-sr commented Feb 7, 2022

Hi David :) definitely try copying the pkl file to your local session. Also, could you post the error message you receive? I assume it simply does not find the pkl?

@DavidRees87
Copy link
Author

DavidRees87 commented Feb 8, 2022 via email

@DavidRees87
Copy link
Author

When running the training with 1024x1024 images I get this error:

/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py in convert(t)
895 return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None,
896 non_blocking, memory_format=convert_to_format)
--> 897 return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
898
899 return self._apply(convert)

RuntimeError: CUDA out of memory. Tried to allocate 64.00 MiB (GPU 0; 15.90 GiB total capacity; 14.87 GiB already allocated; 27.75 MiB free; 14.87 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

I have Colab Pro+ and it doesn't look like there is a lack of memory. Any suggestions on what I can do?

Thanks

@woctezuma
Copy link

RuntimeError: CUDA out of memory

Relevant:

@DavidRees87
Copy link
Author

DavidRees87 commented Feb 9, 2022 via email

@xl-sr
Copy link
Contributor

xl-sr commented Feb 10, 2022

yes, those are very likely too large and need some special treatment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants