Handle HRDPS change from west domain to continental domain #156
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ECCC stopped producing 2.5km HRDPS west product on 22-Feb-2023. It was part of the polar stereographic grid product suite that they replaced with the rotated lat-lon grid product, but that product is only available for the continental domain.
Replaces --yesterday option. ECCC hpfx server holds ~60 days of archived model products. So, we now have the option of downloading for dates further into the past than just the previous day.
douglatornell
added
bug
Codecov Report
@@ Coverage Diff @@
## main #156 +/- ##
=======================================
Coverage ? 75.71%
=======================================
Files ? 127
Lines ? 16839
Branches ? 1199
=======================================
Hits ? 12750
Misses ? 4038
Partials ? 51
Flags with carried forward coverage won't be shown. Click here to find out more.
📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
Includes part of work required for issue #23
Includes part of work required for issue #23
Use SalishSeaCast branch in SalishSeaCast/pywgrib2_xr fork to work under Python 3.10 and xarray>=2022.11. Also requires installation of libwgrib2 from SalishSeaCast branch in SalishSeaCast/libwgrib2 fork.
Mostly to trigger another workflow run with tweaked setup.py in the pywgrib2_xr fork.
Mostly to trigger another workflow run with tweaked setup.py in the pywgrib2_xr fork.
Artefact of early days of SalishSeaNowcast development before automation included assurance that
Handles finicky details of pywgrib2_xr.wgrib(): * all pywgrib2_xr.wgrib() args must be strings * files must be freed after use to close them
Includes part of work required for issue #23.
Total cloud in percent that was used for parametrization of radiation missing from 2007-2014 GEMLAM. No longer needed.
"time", "longitude", and "latitude" variables from GRIB files are replaced by time_counter, "nav_lon", and "nav_lat" in NEMO datasets, so they are unneeded.
Necessary so that we can use xarray.combine_by_coords() to build 3-section run-date dataset.
Reduces grib_to_netcdf memory footprint and processing time a little compared to using dask's default threads scheduler.
Also improve test coverage of _write_netcdf().
|
Susan did checks on generated netCDF files at various points, comparing them to those generated by the old version of I ran |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
ECCC dropped the HRDPS west polar stereographic grid product that we were using in favour of the continental rotated lat-lon grid product on 22-Feb-2023.