-
-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Batch Processing Freezes #53806
Comments
Version: QGIS version Active Python plugins |
As a workaround, you can try to close qgis, a popup will open, click yes to cancel pending tasks, qgis should remain open, hit run again and it may finish this time. |
The same problem occurs in 3.28.9. |
Unfortunately I have the same problem. QGIS 3.24 is the last version that has no problem with batch processing. I tried with with a new QGIS profile but without success. I also tried the same with 3 other computers at my workplace (all have different specs, but same OS - Windows 10 Pro 20H2). It doesn't matter how many "rows" are there, how big are the files or how resource heavy is process being used - the batch processing freezes anyway. |
I've tried extensively to reproduce this with no luck. If it's still reproducible in current QGIS versions, can someone please post a workflow which is able to demonstrate the issue? |
If you select layers loaded in Qgis, the problem occurs. If you load layers from a file, the problem no longer exists. |
Refs qgis#53806 The crash here is coming from sip internals -- somewhere it is triggering a Python SystemError. I can't solve this one, so just port the algorithm to c++ and deal with the much improved performance instead.
@nyalldawson It's very hard (impossible?) to provide a sample project to reproduce... This deadlock is very random. |
Refs #53806 The crash here is coming from sip internals -- somewhere it is triggering a Python SystemError. I can't solve this one, so just port the algorithm to c++ and deal with the much improved performance instead.
It also seems to happen more commonly when there are a lot of items in the batch (40+) and will stop at a random point. Using gdal translate to change tiff to jpg in batch is also an easy case. Just split a tiff into many subfile (I get mine fron GEE though), then change their extension with gdal translate. With 120 small files I get a stall around 20 to 40 items done-> Trigger the batch cancel-> keep the dialog open-> remove the first elements that were processed -> run again -> repeat until all done. |
Sorry for replying so late. I'm not a dev so I have no idea it this is what you wanted Nyall. Please let me know if there's anything else I can do. I've uploaded two videos to a Google Drive folder here Both videos show QGIS version 3.32.2 on a Windows 10 machine (the os is up to date). First video is called workflow_1.mp4. Second video is called workflow_2.mp4. I've tried the same today on QGIS 3.32.3 but the problem still occurs. This problem does not appear on QGIS 3.24 and earlier. |
Unfortunately I still can't reproduce . I'll have to leave this to someone else to debug. |
Hello, I have exactly the same problem on various batch processing models, when I try to work on 70, 100, or 800 files. Thanks for the solution to use QGIS 3.24 (3.24.3 for me), it works fine with that version! QGIS 3.32.3 (but same problem with an older version). |
@nyalldawson It might be a windows only |
For me, the problem occurs with files (not loaded as QGIS layers). I didn't tried with layers already loaded in QGIS. |
windows, so I assume it's wondows blocking too many subprocess or something to that effect. |
Can someone please test a build including #54845 and report whether the issue is fixed? |
I have no idea how to work with builds, but if someone can send me a "how-to", I could test that. |
Download this artifact Extract twice and run qgis.exe in bin folder |
@nyalldawson Same issue with #54845 And gdalwarp was not even run. |
Thanks for trying @nyalldawson! |
According to this StackExchange thread, it seems that the aforementioned issue does not occur in the Ubuntu system https://gis.stackexchange.com/questions/464309/qgis-batch-processing-stops-part-way-through-indefinitely-for-no-apparent-reason |
Hello @agiudiceandrea, I have done many times re-projecting the layers. Please refer the attached recorded videos as zip file Please have a look and let me know what to do. Regards, |
Happens with version 3.34.6 on Windows 10, too. A few layers are ok, but with more than ≈10, processing randomly gets stuck. |
What is the bug or the crash?
When running a simple batch process with only 12 rows, it freezes up and does not continue it. Even after waiting for over an hour, it is still frozen. Even after clicking the cancel button, it freezes up unless I click entirely out of QGis.
Sadly no error codes, but the issue appears after running a batch process even on another computer.
My friend also tried the same process on his computer with a different set of temp data, and he also ran into the same issue.
Steps to reproduce the issue
Join Attributes by Location (summary) --> Batch Processing --> County Intersect TMax
Versions
The current released version of QGIS is 3.32.0.
Supported QGIS version
New profile
Additional context
No response
The text was updated successfully, but these errors were encountered: