-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Img Writer: Writing Tiffs is _very_ slow #131
Comments
Yes, the tiff writers (tiff and ome.tiff) are about 6.000% slower than eq. formats like ics. Even with small images.
I removed logging from the TIFF format to check your hypothesis but it did not produce any meaningful performance improvement (up to 0.4 more operations more per second!). Larger files take much longer to write but show the same effect. |
see 46b6799 for the first big improvement. Writing the 160mb file sequentially now takes about 10 seconds instead of the 44 it took before |
great work @gab1one. Reading & Writing Tiffs (and also other formats) is very often used by the users and therefore performance is crucial. |
Further improvements depend on changes in SCIFIO, I will talk with Mark about that. |
Any news on this? I'm still suffering severe performance issues with the Image Writer. Here's an example benchmark workflow: I get the following writing times for the different file formats:
|
I think this is still a SCIFIO Problem. At the moment I can only recommend to use |
I am aware of a SCIFIO issue for improving the performance of TIFF reading: scifio/scifio#7. But is there an issue for improving the behavior of TIFF writing? I couldn't find it. Has anyone profiled why TIFF writing is slow? I can't imagine it would be that hard to fix. #famouslastwords |
@gab1one can you reproduce the problem and open an issue in scifio? |
The slowness issue is reproducible in ImageJ, the relevant SCIFIO issue is scifio/scifio#310. |
Any news regarding tif writing speed? I am currently using the image writer to move my data to the python-nodes and it takes a very long time. |
@tibuch Sorry for the long delay in reply. Unfortunately, no one is working on TIFF performance. I am very sorry this has sat for so long, but the fact is that we still do not have a dedicated SCIFIO developer who has time to prioritize this issue... yet. |
Writing a tiff with e.g. 1024,1024 and Z=51, Channel = 3 in this dimension order is super slow. One reason might be, that it seems that nearly every pixel write action is logged somewhere. @gab1one please reproduce and double check!
The text was updated successfully, but these errors were encountered: