Writing netcdf after running xarray.dataset.reindex to fill gaps in a time series fails due to memory allocation error #7018
Labels
needs triage
Issue that has not been reviewed by xarray team member
Problem Summary
I am attempting to convert a.grib2 file representing a single day's worth of gridded radar rainfall data spanning the continental US, into a netcdf. When a .grib2 is missing timesteps, I am attempting to fill them in with NA values using
xarray.Dataset.reindex
before runningxarray.Dataset.to_netcdf
. However, after I've reindexed the dataset, the script fails due to a memory allocation error. It succeeds if I don't reindex. One clue could be in the fact that the dataset chunks are set to(70, 3500, 7000)
, but whends.to_netcdf
is called, the script fails because it's attempting to load a chunk with dimensions(210, 3500, 7000)
.Accessing Full Reproducible Example
The code and data to reproduce my results can be downloaded from this Dropbox link. The code is also shown below followed by the outputs. Potentially relevant OS and environment information are shown below as well.
Code
Outputs
Environment
The text was updated successfully, but these errors were encountered: