Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue Cuda out of memory #122

Open
Axienne opened this issue Jun 2, 2024 · 1 comment
Open

Issue Cuda out of memory #122

Axienne opened this issue Jun 2, 2024 · 1 comment

Comments

@Axienne
Copy link

Axienne commented Jun 2, 2024

Hi. I have this issue. Does anyone have an answer? The most interesting fact is, this going with the very start, I only first time klick on Start.bat. and this error pop.
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB. GPU 0 has a total capacity of 4.00 GiB of which 0 bytes is free. Of the allocated memory 3.41 GiB is allocated by PyTorch, and 53.04 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)

@maepopi
Copy link

maepopi commented Jun 8, 2024

Hey,
Strange that it happens right from the start. Have you tried clearing the torch GPU cache? It does the trick for me sometimes.
In your console, type "python" while in the virtual environment, then do

import torch

torch.cuda.empty_cache()

exit()

Not sure it will help but there's no harm in trying I guess!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants