You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've noticed that if I try to generate 640x640 images (the highest I can without running out of memory) I have to restart Shark after each generated image, otherwise it crashes. I suspect this is because some part of the system isn't unloading the used memory. Would be great if this could be looked into as it's quite annoying. Also let me know if there is anything I can do to help debugging this.
I'm on AMD (Windows)
Logs: (when trying to make a second image)
File "shark\shark_inference.py", line 224, in load_module
params = load_flatbuffer(
^^^^^^^^^^^^^^^^
File "shark\iree_utils\compile_utils.py", line 475, in load_flatbuffer
vmfb, config, temp_file_to_unlink = load_vmfb_using_mmap(
^^^^^^^^^^^^^^^^^^^^^
File "shark\iree_utils\compile_utils.py", line 411, in load_vmfb_using_mmap
ctx.add_vm_module(mmaped_vmfb)
File "iree\runtime\system_api.py", line 271, in add_vm_module
File "iree\runtime\system_api.py", line 268, in add_vm_modules
SystemExit: Error registering modules: C:\actions-runner\w\SRT\SRT\c\runtime\src\iree\hal\drivers\vulkan\native_allocator.cc:315: RESOURCE_EXHAUSTED; VK_ERROR_OUT_OF_DEVICE_MEMORY; vkAllocateMemory; failed to allocate buffer of length 1719042240; while invoking native function hal.allocator.allocate; while calling import;
[ 1] native hal.allocator.allocate:0 -
[ 0] bytecode module@1:33446 -
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "starlette\routing.py", line 686, in lifespan
File "uvicorn\lifespan\on.py", line 137, in receive
File "asyncio\queues.py", line 158, in get
asyncio.exceptions.CancelledError
The text was updated successfully, but these errors were encountered:
I've noticed that if I try to generate 640x640 images (the highest I can without running out of memory) I have to restart Shark after each generated image, otherwise it crashes. I suspect this is because some part of the system isn't unloading the used memory. Would be great if this could be looked into as it's quite annoying. Also let me know if there is anything I can do to help debugging this.
I'm on AMD (Windows)
Logs: (when trying to make a second image)
The text was updated successfully, but these errors were encountered: