-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
.tif file size exceeds regular tif limits #100
Comments
Underlying challenge with using compression in GTiff format. My saving data with compression leads to this issue. |
See here for an explanation of the issue. I now have my source data uncompressed with BIGTIFF set, but somewhere in our code or terra the files are being written without the correct configuration. Admittedly, without compressing my weather coef file is now 40GB, so we may be reaching the limits of what we can do in single files? |
I'm posting here, although this may be an issue with
terra
. When the data files are too large, PoPS will fail with the above warnings from R. This is likely the weather data file. It appears when the file is being copied to the TEMP location it is being written without the BIGTIFF flag set to YES which allows a .tif file to exceed 4GB. My current weather file is ~2.88GB, but it is compressed. It may be we need to ensure the .tif profile is adjusted when replicating the data (to YES or IF_SAFER), or this may fall toterra
not offering that option. This is not an issue with available RAM.Chris, this is for the 250m CA data.
The text was updated successfully, but these errors were encountered: