TIFFReadEncodedStrip() failed

[AliD6]

I am using rasterio to read tiff files from Minio object storage using file's URL which looks like http://...
I use with rio.open('http://...') as dataset2: img2 = dataset2.read()
I am doing it in a loop that opens file but I get the error
" band 1: IReadBlock failed at X offset 0, Y offset 365: TIFFReadEncodedStrip() failed" .
The point is that I do not get this error on a specific image and it raises randomly on any image & also the next time I run my code it passes that image with no problem but again raises in other random image.
Also I tried with rio.Env(): with rio.open('http://...') as dataset2: img2 = dataset2.read()
but again the same issue.
I searched about it and got many possible causes like network connection and .. but I need to control what happens and make it run completely with no problem.
Thanks in advance :)

[vincentsarago]

To me it sounds like a GDAL cache issue.

Is it it possible that your file changes during your execution? can you try with with rasteiro.Env(GDAL_CACHEMAX=0) or VSI_CACHE=False

[AliD6]

My file does not change during execution. this chapter gets called far after writing image to Minio.
Also none of parameters mentioned above worked but I'm not sure if GDAL_CACHEMAX=0 makes it better or it's just a random action.
In general I have not found the complete solution yet. thanks :)

[sgillies]

@AliD6 TIFFReadEncodedStrip() indicates that you're attempting to read data from an compressed data file. Libtiff can sometimes fail to do this. It's often associated with low memory availability (see this issue discussion for some details and debugging OSGeo/gdal#6071). You should catch RasterioIOError and retry in these situations.