Skip to content

Commit

Permalink
release/public-v2: addd RRFs v1alpha regression tests (#276)
Browse files Browse the repository at this point in the history 
* Add RRFS v1 alpha tests
* Update submodule pointer for fv3atm and its submodules
* Regression test logs for all platforms
  • Loading branch information
@climbfuji
climbfuji committed Nov 17, 2020
1 parent fa29a21 commit 3073eb8
Show file tree
Hide file tree
Showing 17 changed files with 1,764 additions and 207 deletions.
2 changes: 1 addition & 1 deletion FV3
Submodule FV3 updated 5 files
+1 −1 atmos_cubed_sphere
+1 −1 ccpp/physics
+1 −1 ccpp/suites/suite_FV3_GFS_v15p2.xml
+83 −0 ccpp/suites/suite_FV3_RRFS_v1alpha.xml
+1 −1 ccpp/suites/suite_FV3_RRFS_v1beta.xml
1 change: 0 additions & 1 deletion parm/ccpp_global.nml.IN
View file
Original file line number Diff line number Diff line change
Expand Up @@ -152,7 +152,6 @@
lheatstrg = @[LHEATSTRG]
do_mynnedmf = @[DO_MYNNEDMF]
do_mynnsfclay = @[DO_MYNNSFCLAY]
effr_in = .true.
random_clds = .false.
trans_trac = .true.
cnvcld = .true.
Expand Down
1 change: 0 additions & 1 deletion parm/ccpp_regional.nml.IN
View file
Original file line number Diff line number Diff line change
Expand Up @@ -164,7 +164,6 @@
lheatstrg = @[LHEATSTRG]
do_mynnedmf = @[DO_MYNNEDMF]
do_mynnsfclay = @[DO_MYNNSFCLAY]
effr_in = .true.
random_clds = .false.
trans_trac = .true.
cnvcld = .true.
Expand Down
219 changes: 198 additions & 21 deletions tests/RegressionTests_cheyenne.gnu.log
View file
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Thu Oct 29 11:15:36 MDT 2020
Thu Nov 12 15:37:03 MST 2020
Start Regression test


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_regional_control_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_regional_control_prod
Checking test 001 fv3_ccpp_regional_control results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Expand All @@ -22,8 +22,8 @@ Checking test 001 fv3_ccpp_regional_control results ....
Test 001 fv3_ccpp_regional_control PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_regional_2threads_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_regional_2threads_prod
Checking test 002 fv3_ccpp_regional_2threads results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Expand All @@ -42,8 +42,8 @@ Checking test 002 fv3_ccpp_regional_2threads results ....
Test 002 fv3_ccpp_regional_2threads PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_regional_coldstart_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_regional_coldstart_prod
Checking test 003 fv3_ccpp_regional_coldstart results ....
Comparing phyf000.nc .........OK
Comparing phyf003.nc .........OK
Expand All @@ -52,8 +52,8 @@ Checking test 003 fv3_ccpp_regional_coldstart results ....
Test 003 fv3_ccpp_regional_coldstart PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_rrfs_v1beta_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_rrfs_v1beta_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1beta_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1beta_prod
Checking test 004 fv3_ccpp_rrfs_v1beta results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Expand Down Expand Up @@ -132,8 +132,8 @@ Checking test 004 fv3_ccpp_rrfs_v1beta results ....
Test 004 fv3_ccpp_rrfs_v1beta PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_rrfs_v1beta_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_rrfs_v1beta_coldstart_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1beta_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1beta_coldstart_prod
Checking test 005 fv3_ccpp_rrfs_v1beta_coldstart results ....
Comparing phyf000.tile1.nc .........OK
Comparing phyf000.tile2.nc .........OK
Expand Down Expand Up @@ -161,9 +161,9 @@ Checking test 005 fv3_ccpp_rrfs_v1beta_coldstart results ....
Test 005 fv3_ccpp_rrfs_v1beta_coldstart PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_gfs_v15p2_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_gfs_v15p2_prod
Checking test 006 fv3_ccpp_gfs_v15p2 results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1alpha_prod
Checking test 006 fv3_ccpp_rrfs_v1alpha results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand All @@ -176,6 +176,12 @@ Checking test 006 fv3_ccpp_gfs_v15p2 results ....
Comparing phyf000.tile4.nc .........OK
Comparing phyf000.tile5.nc .........OK
Comparing phyf000.tile6.nc .........OK
Comparing phyf012.tile1.nc .........OK
Comparing phyf012.tile2.nc .........OK
Comparing phyf012.tile3.nc .........OK
Comparing phyf012.tile4.nc .........OK
Comparing phyf012.tile5.nc .........OK
Comparing phyf012.tile6.nc .........OK
Comparing phyf024.tile1.nc .........OK
Comparing phyf024.tile2.nc .........OK
Comparing phyf024.tile3.nc .........OK
Expand All @@ -188,6 +194,12 @@ Checking test 006 fv3_ccpp_gfs_v15p2 results ....
Comparing dynf000.tile4.nc .........OK
Comparing dynf000.tile5.nc .........OK
Comparing dynf000.tile6.nc .........OK
Comparing dynf012.tile1.nc .........OK
Comparing dynf012.tile2.nc .........OK
Comparing dynf012.tile3.nc .........OK
Comparing dynf012.tile4.nc .........OK
Comparing dynf012.tile5.nc .........OK
Comparing dynf012.tile6.nc .........OK
Comparing dynf024.tile1.nc .........OK
Comparing dynf024.tile2.nc .........OK
Comparing dynf024.tile3.nc .........OK
Expand All @@ -214,24 +226,189 @@ Checking test 006 fv3_ccpp_gfs_v15p2 results ....
Comparing RESTART/fv_tracer.res.tile4.nc .........OK
Comparing RESTART/fv_tracer.res.tile5.nc .........OK
Comparing RESTART/fv_tracer.res.tile6.nc .........OK
Comparing RESTART/phy_data.tile1.nc .........OK
Comparing RESTART/phy_data.tile2.nc .........OK
Comparing RESTART/phy_data.tile3.nc .........OK
Comparing RESTART/phy_data.tile4.nc .........OK
Comparing RESTART/phy_data.tile5.nc .........OK
Comparing RESTART/phy_data.tile6.nc .........OK
Comparing RESTART/sfc_data.tile1.nc .........OK
Comparing RESTART/sfc_data.tile2.nc .........OK
Comparing RESTART/sfc_data.tile3.nc .........OK
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 006 fv3_ccpp_rrfs_v1alpha PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1alpha_coldstart_prod
Checking test 007 fv3_ccpp_rrfs_v1alpha_coldstart results ....
Comparing phyf000.tile1.nc .........OK
Comparing phyf000.tile2.nc .........OK
Comparing phyf000.tile3.nc .........OK
Comparing phyf000.tile4.nc .........OK
Comparing phyf000.tile5.nc .........OK
Comparing phyf000.tile6.nc .........OK
Comparing phyf012.tile1.nc .........OK
Comparing phyf012.tile2.nc .........OK
Comparing phyf012.tile3.nc .........OK
Comparing phyf012.tile4.nc .........OK
Comparing phyf012.tile5.nc .........OK
Comparing phyf012.tile6.nc .........OK
Comparing dynf000.tile1.nc .........OK
Comparing dynf000.tile2.nc .........OK
Comparing dynf000.tile3.nc .........OK
Comparing dynf000.tile4.nc .........OK
Comparing dynf000.tile5.nc .........OK
Comparing dynf000.tile6.nc .........OK
Comparing dynf012.tile1.nc .........OK
Comparing dynf012.tile2.nc .........OK
Comparing dynf012.tile3.nc .........OK
Comparing dynf012.tile4.nc .........OK
Comparing dynf012.tile5.nc .........OK
Test 007 fv3_ccpp_rrfs_v1alpha_coldstart PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_gfs_v15p2_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_gfs_v15p2_prod
Checking test 008 fv3_ccpp_gfs_v15p2 results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Comparing atmos_4xdaily.tile4.nc .........OK
Comparing atmos_4xdaily.tile5.nc .........OK
Comparing atmos_4xdaily.tile6.nc .........OK
Comparing phyf000.tile1.nc .........OK
Comparing phyf000.tile2.nc .........OK
Comparing phyf000.tile3.nc .........OK
Comparing phyf000.tile4.nc .........OK
Comparing phyf000.tile5.nc .........OK
Comparing phyf000.tile6.nc .........OK
Comparing phyf024.tile1.nc .........OK
Comparing phyf024.tile2.nc .........OK
Comparing phyf024.tile3.nc .........OK
Comparing phyf024.tile4.nc .........OK
Comparing phyf024.tile5.nc .........OK
Comparing phyf024.tile6.nc .........OK
Comparing dynf000.tile1.nc .........OK
Comparing dynf000.tile2.nc .........OK
Comparing dynf000.tile3.nc .........OK
Comparing dynf000.tile4.nc .........OK
Comparing dynf000.tile5.nc .........OK
Comparing dynf000.tile6.nc .........OK
Comparing dynf024.tile1.nc .........OK
Comparing dynf024.tile2.nc .........OK
Comparing dynf024.tile3.nc .........OK
Comparing dynf024.tile4.nc .........OK
Comparing dynf024.tile5.nc .........OK
Comparing dynf024.tile6.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Comparing RESTART/fv_core.res.tile2.nc .........OK
Comparing RESTART/fv_core.res.tile3.nc .........OK
Comparing RESTART/fv_core.res.tile4.nc .........OK
Comparing RESTART/fv_core.res.tile5.nc .........OK
Comparing RESTART/fv_core.res.tile6.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile2.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile3.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile4.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile5.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile6.nc .........OK
Comparing RESTART/fv_tracer.res.tile1.nc .........OK
Comparing RESTART/fv_tracer.res.tile2.nc .........OK
Comparing RESTART/fv_tracer.res.tile3.nc .........OK
Comparing RESTART/fv_tracer.res.tile4.nc .........OK
Comparing RESTART/fv_tracer.res.tile5.nc .........OK
Comparing RESTART/fv_tracer.res.tile6.nc .........OK
Comparing RESTART/sfc_data.tile1.nc .........OK
Comparing RESTART/sfc_data.tile2.nc .........OK
Comparing RESTART/sfc_data.tile3.nc .........OK
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Comparing RESTART/phy_data.tile1.nc .........OK
Comparing RESTART/phy_data.tile2.nc .........OK
Comparing RESTART/phy_data.tile3.nc .........OK
Comparing RESTART/phy_data.tile4.nc .........OK
Comparing RESTART/phy_data.tile5.nc .........OK
Comparing RESTART/phy_data.tile6.nc .........OK
Test 008 fv3_ccpp_gfs_v15p2 PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1alpha_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1alpha_debug_prod
Checking test 009 fv3_ccpp_rrfs_v1alpha_debug results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Comparing atmos_4xdaily.tile4.nc .........OK
Comparing atmos_4xdaily.tile5.nc .........OK
Comparing atmos_4xdaily.tile6.nc .........OK
Comparing phyf000.tile1.nc .........OK
Comparing phyf000.tile2.nc .........OK
Comparing phyf000.tile3.nc .........OK
Comparing phyf000.tile4.nc .........OK
Comparing phyf000.tile5.nc .........OK
Comparing phyf000.tile6.nc .........OK
Comparing phyf003.tile1.nc .........OK
Comparing phyf003.tile2.nc .........OK
Comparing phyf003.tile3.nc .........OK
Comparing phyf003.tile4.nc .........OK
Comparing phyf003.tile5.nc .........OK
Comparing phyf003.tile6.nc .........OK
Comparing dynf000.tile1.nc .........OK
Comparing dynf000.tile2.nc .........OK
Comparing dynf000.tile3.nc .........OK
Comparing dynf000.tile4.nc .........OK
Comparing dynf000.tile5.nc .........OK
Comparing dynf000.tile6.nc .........OK
Comparing dynf003.tile1.nc .........OK
Comparing dynf003.tile2.nc .........OK
Comparing dynf003.tile3.nc .........OK
Comparing dynf003.tile4.nc .........OK
Comparing dynf003.tile5.nc .........OK
Comparing dynf003.tile6.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Comparing RESTART/fv_core.res.tile2.nc .........OK
Comparing RESTART/fv_core.res.tile3.nc .........OK
Comparing RESTART/fv_core.res.tile4.nc .........OK
Comparing RESTART/fv_core.res.tile5.nc .........OK
Comparing RESTART/fv_core.res.tile6.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile2.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile3.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile4.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile5.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile6.nc .........OK
Comparing RESTART/fv_tracer.res.tile1.nc .........OK
Comparing RESTART/fv_tracer.res.tile2.nc .........OK
Comparing RESTART/fv_tracer.res.tile3.nc .........OK
Comparing RESTART/fv_tracer.res.tile4.nc .........OK
Comparing RESTART/fv_tracer.res.tile5.nc .........OK
Comparing RESTART/fv_tracer.res.tile6.nc .........OK
Comparing RESTART/phy_data.tile1.nc .........OK
Comparing RESTART/phy_data.tile2.nc .........OK
Comparing RESTART/phy_data.tile3.nc .........OK
Comparing RESTART/phy_data.tile4.nc .........OK
Comparing RESTART/phy_data.tile5.nc .........OK
Comparing RESTART/phy_data.tile6.nc .........OK
Test 006 fv3_ccpp_gfs_v15p2 PASS
Comparing RESTART/sfc_data.tile1.nc .........OK
Comparing RESTART/sfc_data.tile2.nc .........OK
Comparing RESTART/sfc_data.tile3.nc .........OK
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 009 fv3_ccpp_rrfs_v1alpha_debug PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201027/GNU/fv3_gfs_v15p2_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_26513/fv3_ccpp_gfs_v15p2_debug_prod
Checking test 007 fv3_ccpp_gfs_v15p2_debug results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_gfs_v15p2_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_gfs_v15p2_debug_prod
Checking test 010 fv3_ccpp_gfs_v15p2_debug results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand Down Expand Up @@ -294,9 +471,9 @@ Checking test 007 fv3_ccpp_gfs_v15p2_debug results ....
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 007 fv3_ccpp_gfs_v15p2_debug PASS
Test 010 fv3_ccpp_gfs_v15p2_debug PASS


REGRESSION TEST WAS SUCCESSFUL
Thu Oct 29 11:32:03 MDT 2020
Elapsed time: 00h:16m:28s. Have a nice day!
Thu Nov 12 15:50:20 MST 2020
Elapsed time: 00h:13m:18s. Have a nice day!
Loading

0 comments on commit 3073eb8

Please sign in to comment.