Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Several issues with how some of the hrrr 'quilt restart' tests are configured #1832

Closed
DusanJovic-NOAA opened this issue Jul 11, 2023 · 2 comments
Assignees

Comments

@DusanJovic-NOAA
Copy link
Collaborator

There are several issues with how some of the hrrr 'quilt restart' tests are configured.

All quilt restart tests are supposed to exactly reproduce the restart outputs compared to the corresponding non-quilt restart tests, for example hrrr_control_qr must produce identical restart files as hrrr_control. In order to test this both of these tests have the same baseline directory (CNTL_DIR variable in test configuration file). Because of this only one of these two tests, and only one of these two tests, should be labeled as a test that generates new baselines, by having the string 'baseline' in the 4th column in rt.conf. This is not the case for these tests:

hrrr_control_qr (intel version)
hrrr_control_qr_dyn32_phy32 (intel version)
hrrr_control_qr (gnu version)
hrrr_control_qr_dyn32_phy32 (gnu version)

Another issue is that some 'qr' tests, I found one so far, have different baseline directory compared to the corresponding non-qr version. Tests hrrr_control_dyn32_phy32 and hrrr_control_qr_dyn32_phy32 should have the same baseline directory but they do not:

$ grep CNTL_DIR tests/hrrr_control_dyn32_phy32
export CNTL_DIR=hrrr_control_dyn32_phy32

$ grep CNTL_DIR tests/hrrr_control_qr_dyn32_phy32
export CNTL_DIR=hrrr_control_qr_dyn32_phy32

At some point we will switch to running all or most of the tests using quilting restart, but before we do that these issues must be fixed so that we are sure that quilting restart works correctly.

This was referenced Jul 14, 2023
@zach1221
Copy link
Collaborator

Hi, Dusan-

This change has been added for hrrr_control and hrrr_control_qr in PR 1777. I think we just need to do the same now for hrrr_control_dyn32_phy32 and hrrr_control_qr_dyn32_phy32 . Then this issue can be closed. @jkbk2004

@zach1221
Copy link
Collaborator

zach1221 commented Nov 8, 2023

This issue can be closed now. These changes are reflected in rt.conf. Baseslines listed for only the non qr cases.
gnu
image
intel
image

@zach1221 zach1221 closed this as completed Nov 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
2 participants