You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Continuing Previous Issue: [Errno 2] No such file or directory: '\kohya_ss\venv\Scripts\accelerate.exe\main.py' Issue 38
I compared it with original Kohya script and found that somehow this is consuming lots of RAMs and I guess it doesn't transfer the CKPT to VRAM, The Original Kohya script is working well, so I literally used the same VENV to run this.
This is my Task Manager RAM graph, we can see that there's sudden increase in RAM and then it crashes, 16GB RAM, graph time previous 30 seconds.
This doesn't happen in the original training script. this resulting in the Issue 38.
When using the original Training Script, the CKPT is transferred to VRAM thus resulting in successful training.
The text was updated successfully, but these errors were encountered:
Is there a discrete GPU on your machine? The scroll bar on the taskmgr seems to end at GPU 0. If that's the case, your statements on vram is incorrect. Intel UHD "VRAM is actually pulling from system ram.
The last graph also seem to indicate eating more ram than the previous 2 graphs, could be a scale thing. Taskmgr graphs are woefully inadequate to make conclusions.
Is there a discrete GPU on your machine? The scroll bar on the taskmgr seems to end at GPU 0. If that's the case, your statements on vram is incorrect. Intel UHD "VRAM is actually pulling from system ram.
The last graph also seem to indicate eating more ram than the previous 2 graphs, could be a scale thing. Taskmgr graphs are woefully inadequate to make conclusions.
Yes, I have RTX 3080TI.
In the second graph it loads the ckpt and then transfers it to GPU vram. In the first graph it doesn't happen.
Continuing Previous Issue: [Errno 2] No such file or directory: '\kohya_ss\venv\Scripts\accelerate.exe\main.py'
Issue 38
I compared it with original Kohya script and found that somehow this is consuming lots of RAMs and I guess it doesn't transfer the CKPT to VRAM, The Original Kohya script is working well, so I literally used the same VENV to run this.
This is my Task Manager RAM graph, we can see that there's sudden increase in RAM and then it crashes, 16GB RAM, graph time previous 30 seconds.
This doesn't happen in the original training script. this resulting in the Issue 38.
When using the original Training Script, the CKPT is transferred to VRAM thus resulting in successful training.
The text was updated successfully, but these errors were encountered: