Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cleaning up GRIB2 encoding for index 508 (max precip rate) #708

Merged
merged 4 commits into from
May 24, 2023

Conversation

EricJames-NOAA
Copy link
Contributor

This PR corrects the GRIB2 encoding for index 508, 1-h max precip rate. The previous code was causing problems with wgrib2 for the 0-h forecast.

The change was tested for the RRFS_CONUS_3km system on Jet.

@WenMeng-NOAA WenMeng-NOAA linked an issue May 21, 2023 that may be closed by this pull request
@WenMeng-NOAA
Copy link
Collaborator

@EricJames-NOAA Can you sync your branch with the latest UPP develop?

@WenMeng-NOAA WenMeng-NOAA added Ready for Review This PR is ready for code review. 3DRTMA labels May 23, 2023
@WenMeng-NOAA
Copy link
Collaborator

The UPP RT tests were conducted on WCOSS2. This PR will fix the max PRATE issue in 3DRTMA test too since it uses the same control file fv3lam_rrfs.xml as RRFS.

Before:  record 768 in dataset PRSLEV00.tm00 has issue in grib2 head as
** ERROR bad grib message: Statistical Processing bad n=0 **
768:708561531:d=2023040400:PRATE:surface::

*** FATAL ERROR (delayed): PDT size error

*** FATAL ERROR (delayed): forecast time

Now it is fixed as:
768:708561531:d=2023040400:PRATE:surface:0-0 day max fcst:

@EdwardColon-NOAA Please be aware of the fix for 3DRTMA.

@EdwardColon-NOAA
Copy link
Contributor

EdwardColon-NOAA commented May 23, 2023 via email

@WenMeng-NOAA
Copy link
Collaborator

@EricJames-NOAA Please let me know if my testing for 3DRTMA is not consistent with your testing.

@WenMeng-NOAA
Copy link
Collaborator

@FernandoAndrade-NOAA You may start the RT tests on Hera and Orion and would expect changed results for 3DRTMA.

@EricJames-NOAA
Copy link
Contributor Author

@EricJames-NOAA Please let me know if my testing for 3DRTMA is not consistent with your testing.

@WenMeng-NOAA your results are in agreement with mine! Thanks for your test!

@FernandoAndrade-NOAA
Copy link
Collaborator

UPP RTs have finished on Hera and Orion. @WenMeng-NOAA could you adjust the permissions for the recreated data for Orion from earlier? Tests failed due to permission issues. I can run RTs again after that. On Hera the following changes in test results for 3drtma PRSLEV00:

39:38622976:REFZR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
40:38861307:REFZI:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
49:49740509:PBLREG:surface:rpn_corr=-nan:rpn_rms=undefined
703:635158661:REFZR:4000 m above ground:rpn_corr=-nan:rpn_rms=undefined
704:635396992:REFZI:4000 m above ground:rpn_corr=-nan:rpn_rms=undefined
706:636307658:REFZR:1000 m above ground:rpn_corr=-nan:rpn_rms=undefined
707:636545989:REFZI:1000 m above ground:rpn_corr=-nan:rpn_rms=undefined
763:706867267:POT:10 m above ground:rpn_corr=-nan:rpn_rms=undefined
764:707105598:SPFH:10 m above ground:rpn_corr=-nan:rpn_rms=undefined
771:708848749:NCPCP:surface:rpn_corr=-nan:rpn_rms=undefined
772:709087104:NCPCP:surface:rpn_corr=-nan:rpn_rms=undefined
773:709325459:LSPA:surface:rpn_corr=-nan:rpn_rms=undefined
774:709563814:FROZR:surface:rpn_corr=-nan:rpn_rms=undefined
775:709802169:FRZR:surface:rpn_corr=-nan:rpn_rms=undefined
776:710040524:TSNOWP:surface:rpn_corr=-nan:rpn_rms=undefined
777:710278879:SNOM:surface:rpn_corr=-nan:rpn_rms=undefined
779:710806896:BGRUN:surface:rpn_corr=-nan:rpn_rms=undefined
780:711045251:WATR:surface:rpn_corr=-nan:rpn_rms=undefined
781:711283606:FROZR:surface:rpn_corr=-nan:rpn_rms=undefined
782:711521961:FRZR:surface:rpn_corr=-nan:rpn_rms=undefined
783:711760316:TSNOWP:surface:rpn_corr=-nan:rpn_rms=undefined
803:719949471:EVP:surface:rpn_corr=-nan:rpn_rms=undefined
808:724160781:UFLX:surface:rpn_corr=-nan:rpn_rms=undefined
809:724399112:VFLX:surface:rpn_corr=-nan:rpn_rms=undefined
822:736790094:AOTK:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
834:743273527:SWHR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
835:743511858:LWHR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
843:749857987:CDLYR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
861:774780663:ULWRF:top of atmosphere:rpn_corr=-nan:rpn_rms=undefined
866:781476740:AEMFLX:surface:rpn_corr=-nan:rpn_rms=undefined
867:781715095:FWINX:surface:rpn_corr=-nan:rpn_rms=undefined
868:781953426:CSDSF:surface:rpn_corr=-nan:rpn_rms=undefined
1023:989943481:ALBDO:surface:rpn_corr=-nan:rpn_rms=undefined
1024:990181812:SNFALB:surface:rpn_corr=-nan:rpn_rms=undefined

@WenMeng-NOAA
Copy link
Collaborator

UPP RTs have finished on Hera and Orion. @WenMeng-NOAA could you adjust the permissions for the recreated data for Orion from earlier? Tests failed due to permission issues. I can run RTs again after that. On Hera the following changes in test results for 3drtma PRSLEV00:

39:38622976:REFZR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
40:38861307:REFZI:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
49:49740509:PBLREG:surface:rpn_corr=-nan:rpn_rms=undefined
703:635158661:REFZR:4000 m above ground:rpn_corr=-nan:rpn_rms=undefined
704:635396992:REFZI:4000 m above ground:rpn_corr=-nan:rpn_rms=undefined
706:636307658:REFZR:1000 m above ground:rpn_corr=-nan:rpn_rms=undefined
707:636545989:REFZI:1000 m above ground:rpn_corr=-nan:rpn_rms=undefined
763:706867267:POT:10 m above ground:rpn_corr=-nan:rpn_rms=undefined
764:707105598:SPFH:10 m above ground:rpn_corr=-nan:rpn_rms=undefined
771:708848749:NCPCP:surface:rpn_corr=-nan:rpn_rms=undefined
772:709087104:NCPCP:surface:rpn_corr=-nan:rpn_rms=undefined
773:709325459:LSPA:surface:rpn_corr=-nan:rpn_rms=undefined
774:709563814:FROZR:surface:rpn_corr=-nan:rpn_rms=undefined
775:709802169:FRZR:surface:rpn_corr=-nan:rpn_rms=undefined
776:710040524:TSNOWP:surface:rpn_corr=-nan:rpn_rms=undefined
777:710278879:SNOM:surface:rpn_corr=-nan:rpn_rms=undefined
779:710806896:BGRUN:surface:rpn_corr=-nan:rpn_rms=undefined
780:711045251:WATR:surface:rpn_corr=-nan:rpn_rms=undefined
781:711283606:FROZR:surface:rpn_corr=-nan:rpn_rms=undefined
782:711521961:FRZR:surface:rpn_corr=-nan:rpn_rms=undefined
783:711760316:TSNOWP:surface:rpn_corr=-nan:rpn_rms=undefined
803:719949471:EVP:surface:rpn_corr=-nan:rpn_rms=undefined
808:724160781:UFLX:surface:rpn_corr=-nan:rpn_rms=undefined
809:724399112:VFLX:surface:rpn_corr=-nan:rpn_rms=undefined
822:736790094:AOTK:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
834:743273527:SWHR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
835:743511858:LWHR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
843:749857987:CDLYR:entire atmosphere (considered as a single layer):rpn_corr=-nan:rpn_rms=undefined
861:774780663:ULWRF:top of atmosphere:rpn_corr=-nan:rpn_rms=undefined
866:781476740:AEMFLX:surface:rpn_corr=-nan:rpn_rms=undefined
867:781715095:FWINX:surface:rpn_corr=-nan:rpn_rms=undefined
868:781953426:CSDSF:surface:rpn_corr=-nan:rpn_rms=undefined
1023:989943481:ALBDO:surface:rpn_corr=-nan:rpn_rms=undefined
1024:990181812:SNFALB:surface:rpn_corr=-nan:rpn_rms=undefined

The changed results of 3DRTMA on Hera are consistent with mine on WCOSS2. I just changed the permission on Orion. Please try again. @FernandoAndrade-NOAA

Copy link
Collaborator

@FernandoAndrade-NOAA FernandoAndrade-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hera RTs passed with expected changes in 3DRTMA. Orion rap RTs failed due to permission issues & Orion is down for maintenance today, however the changes in the Orion 3DRTMA results were as expected.

@WenMeng-NOAA
Copy link
Collaborator

This PR is ready for merging. A new baseline is needed to be created for 3DRTMA.

@WenMeng-NOAA WenMeng-NOAA added the Baseline Change The baselines of the UPP regression tests are changed. label May 24, 2023
@WenMeng-NOAA WenMeng-NOAA merged commit c450a49 into NOAA-EMC:develop May 24, 2023
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3DRTMA Baseline Change The baselines of the UPP regression tests are changed. Ready for Review This PR is ready for code review. RRFS
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Revise GRIB2 encoding for 1-h max precip rate
4 participants