Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[develop] Add new RRFS variables such as NWGES and workflow control variables #647

Closed
Show file tree
Hide file tree
Changes from 41 commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
8c2325b
Update nco: config section.
danielabdi-noaa Mar 7, 2023
4a2fc0e
Add the DO_ parameters from rrfs_dev.
danielabdi-noaa Mar 7, 2023
6a13df3
Put values for RRFS_NA_13km predef grid from RRFS_dev1 in comments.
danielabdi-noaa Mar 7, 2023
257bcc1
Add workflow definitons.
danielabdi-noaa Mar 8, 2023
1e10b56
Modify FIXdir.
danielabdi-noaa Mar 8, 2023
006f562
Add 3km HRRRIC predef grid.
danielabdi-noaa Mar 9, 2023
8e6787b
Add more stuff needed for workflow generation.
danielabdi-noaa Mar 9, 2023
b233633
Add machne file modifications.
danielabdi-noaa Mar 9, 2023
8396339
Add FIX directories.
danielabdi-noaa Mar 9, 2023
3bffba4
Add workflow and test case.
danielabdi-noaa Mar 9, 2023
7bcb169
Turn off all rrfs options in test case, turn them on later as PRs get…
danielabdi-noaa Mar 10, 2023
913e41a
Temporarily turn off jinja template variable existence test for RRFS …
danielabdi-noaa Mar 10, 2023
4a733de
Add missing TN_PLOT_ALLVARS definition.
danielabdi-noaa Mar 10, 2023
9f9e7fa
Minor bugfix duplict namelist fn.
danielabdi-noaa Mar 13, 2023
183973e
Use HPSS queue for get_ics/lbcs
danielabdi-noaa Mar 13, 2023
62490ac
Move input nml modificaiton to next PR.
danielabdi-noaa Mar 13, 2023
27a6e46
Temporarily turn off fcstfv3_lam subdirectory unitl run_fcst is mergd.
danielabdi-noaa Mar 13, 2023
fb41d4f
Make stochastic physics forecast work.
danielabdi-noaa Mar 14, 2023
ffe4c17
Temporarily fix run_fcst name to prod.
danielabdi-noaa Mar 14, 2023
b82d7ec
Merge branch 'develop' into feature/rrfs_params
danielabdi-noaa Mar 17, 2023
60b6717
Remove custom rrfs fix file.
danielabdi-noaa Mar 17, 2023
2873640
Update nwges comment.
danielabdi-noaa Mar 17, 2023
7528d52
Merge branch 'develop' into feature/rrfs_params
danielabdi-noaa Mar 20, 2023
0a4ea2d
Add back accidentally removed FCST_DIR
danielabdi-noaa Mar 20, 2023
d13d64b
Merge branch 'develop' into feature/rrfs_params
danielabdi-noaa Mar 23, 2023
db8524f
Set RRFS data patsh for realtime/retrospective runs.
danielabdi-noaa Mar 23, 2023
72e3898
Merge branch 'develop' into feature/rrfs_params
danielabdi-noaa Mar 24, 2023
dba1c0f
Fixes due to merge.
danielabdi-noaa Mar 24, 2023
742846b
Remove DO_RETRO flag.
danielabdi-noaa Mar 24, 2023
3320ee5
Fix RESTART_INTERVAL locations.
danielabdi-noaa Mar 25, 2023
4523e8c
Revert back to old way of creating FIXam
danielabdi-noaa Mar 25, 2023
289a318
Other fixes.
danielabdi-noaa Mar 25, 2023
f32b6af
Remove unused variables.
danielabdi-noaa Mar 27, 2023
adb2eee
Revert accidently removed conditions.
danielabdi-noaa Mar 27, 2023
dd4749a
Update realtime lightning_root on jet.
danielabdi-noaa Mar 28, 2023
be2db74
Update lightning_root paths for retro runs.
danielabdi-noaa Mar 31, 2023
93d5374
Merge branch 'develop' into feature/rrfs_params
danielabdi-noaa Apr 1, 2023
d33219b
Update test config file to conform to new format.
danielabdi-noaa Apr 1, 2023
c94ef05
Remove 3km HRRRIC predef grid.
danielabdi-noaa Apr 3, 2023
96fef95
Add HPSS_ACCOUNT.
danielabdi-noaa Apr 3, 2023
992becc
Keep predef grids we have in SRW.
danielabdi-noaa Apr 3, 2023
5598722
Add missing config options.
danielabdi-noaa Apr 5, 2023
c05132e
Merge branch 'develop' into feature/rrfs_params
danielabdi-noaa Apr 5, 2023
dc5340f
Add some variable updates from RRFS_dev1
danielabdi-noaa Apr 5, 2023
08737e0
Remove ARCHIVEDIR and NCL vars.
danielabdi-noaa Apr 7, 2023
0db4606
Bug fix FCST_LEN_CYCL
danielabdi-noaa Apr 7, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 24 additions & 7 deletions scripts/exregional_run_fcst.sh
Original file line number Diff line number Diff line change
Expand Up @@ -434,6 +434,24 @@ cat > itag <<EOF
EOF
fi

#
#-----------------------------------------------------------------------
#
# Choose namelist file to use
#
#-----------------------------------------------------------------------
#
STOCH="FALSE"
if [ "${DO_ENSEMBLE}" = "TRUE" ] && ([ "${DO_SPP}" = "TRUE" ] || [ "${DO_SPPT}" = "TRUE" ] || [ "${DO_SHUM}" = "TRUE" ] || \
[ "${DO_SKEB}" = "TRUE" ] || [ "${DO_LSM_SPP}" = "TRUE" ]); then
STOCH="TRUE"
fi
if [ "${STOCH}" == "TRUE" ]; then
ln_vrfy -sf ${FV3_NML_STOCH_FP} ${DATA}/${FV3_NML_FN}
else
ln_vrfy -sf ${FV3_NML_FP} ${DATA}/${FV3_NML_FN}
fi

Copy link
Collaborator Author

@danielabdi-noaa danielabdi-noaa Mar 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is needed to pick the right namelist file for stochastic physics. We currently directly modify the input namelist in SRW. This was needed to get community_ensemble_2memss_stoch working @JeffBeck-NOAA

if [ "${CPL_AQM}" = "TRUE" ]; then
#
#-----------------------------------------------------------------------
Expand Down Expand Up @@ -468,20 +486,19 @@ fi
#
#-----------------------------------------------------------------------
#

if [ "${DO_ENSEMBLE}" = TRUE ] && ([ "${DO_SPP}" = TRUE ] || [ "${DO_SPPT}" = TRUE ] || [ "${DO_SHUM}" = TRUE ] || \
[ "${DO_SKEB}" = TRUE ] || [ "${DO_LSM_SPP}" = TRUE ]); then
# Set stochastic physics seeds
#
#-----------------------------------------------------------------------
#
if [ "$STOCH" == "TRUE" ]; then
cp_vrfy ${DATA}/${FV3_NML_FN} ${DATA}/${FV3_NML_FN}_base
python3 $USHdir/set_FV3nml_ens_stoch_seeds.py \
--path-to-defns ${GLOBAL_VAR_DEFNS_FP} \
--cdate "$CDATE" || print_err_msg_exit "\
Call to function to create the ensemble-based namelist for the current
cycle's (cdate) run directory (DATA) failed:
cdate = \"${CDATE}\"
DATA = \"${DATA}\""
else
create_symlink_to_file target="${FV3_NML_FP}" \
symlink="${DATA}/${FV3_NML_FN}" \
relative="${relative_link_flag}"
fi
#
#-----------------------------------------------------------------------
Expand Down
137 changes: 137 additions & 0 deletions ush/config.rrfs.yaml
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file should not be added yet. We don't have the capabilities in place to run or test any of it, and many of the settings here will not ever be supported in SRW.

Copy link
Collaborator Author

@danielabdi-noaa danielabdi-noaa Apr 7, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually you can run it even now. It will generate a workflow file that doesn't have any of the rrfs tasks.

Original file line number Diff line number Diff line change
@@ -0,0 +1,137 @@
metadata:
description: >-
Sample config file for the work of importing RRFS_dev1 tasks
to SRW
user:
RUN_ENVIR: nco
MACHINE: hera
ACCOUNT: zrtrr
SERVICE_ACCOUNT: zrtrr
HPSS_ACCOUNT: zrtrr
platform:
RESERVATION: ""
SST_update_hour: 1
GVF_update_hour: 4
SNOWICE_update_hour: 0
ARCHIVEDIR: "/1year/BMC/wrfruc/rrfs_dev1"
NCARG_ROOT: "/apps/ncl/6.5.0-CentOS6.10_64bit_nodap_gnu447"
NCL_HOME: "/home/rtrr/RRFS/graphics"
NCL_REGION: "conus"
DOMAIN_PREGEN_BASEDIR: "/scratch2/BMC/gsd-hpcs/Daniel.Abdi/rrfs_dev/ufs-srweather-app/regional_workflow/fix/lam"
FIXgsi: "/scratch2/BMC/gsd-hpcs/Daniel.Abdi/rrfs_dev/ufs-srweather-app/regional_workflow/fix/gsi"
FIXcrtm: "/scratch2/BMC/gsd-hpcs/Daniel.Abdi/rrfs_dev/ufs-srweather-app/regional_workflow/fix/crtm/CRTM_v2.3.0"
FIXcrtmupp: "/scratch2/BMC/gsd-hpcs/Daniel.Abdi/rrfs_dev/ufs-srweather-app/regional_workflow/fix/crtm/CRTM_v2.4.0"
workflow:
TAG: RRFS_CONUS_3km_
USE_CRON_TO_RELAUNCH: false
EXPT_SUBDIR: RRFS_CONUS_3km
CCPP_PHYS_SUITE: FV3_HRRR
PREDEF_GRID_NAME: RRFS_CONUS_3km
DATE_FIRST_CYCL: '2022072000'
DATE_LAST_CYCL: '2022072100'
FCST_LEN_HRS: 3
FCST_LEN_HRS_SPINUP: 1
POSTPROC_LEN_HRS: 3
POSTPROC_LONG_LEN_HRS: 12
PREEXISTING_DIR_METHOD: rename
DEBUG: true
VERBOSE: true
COMPILER: intel
CYCL_HRS: [0, 12]
CYCL_HRS_SPINSTART: [3, 15]
CYCL_HRS_PRODSTART: [9, 21]
FCST_LEN_HRS_CYCLES: [12, 3, 3, 12, 3, 3, 12, 3, 3, 12, 3, 3, 12, 3, 3, 12, 3, 3, 12, 3, 3, 12, 3, 3]
DA_CYCLE_INTERV: 1
BOUNDARY_LEN_HRS: 18
BOUNDARY_PROC_GROUP_NUM: 10
rrfs:
DO_DACYCLE: false # turn on later
DO_SURFACE_CYCLE: false # turn on later
DO_SPINUP: false # turn on later
DO_NONVAR_CLDANAL: false # turn on later
DO_REFL2TTEN: false
DO_NLDN_LGHT: false
DO_SOIL_ADJUST: false # turn on later
DO_RADDA: false
DO_BUFRSND: false
DO_RRFS_DEV: true
DO_POST_SPINUP: false # turn on later
DO_POST_PROD: false # turn on later
cycledefs:
INITIAL_CYCLEDEF: '{{ [workflow.DATE_FIRST_CYCL[0:8], "0300 ", workflow.DATE_LAST_CYCL[0:8], "2300 12:00:00"]|join }}'
BOUNDARY_CYCLEDEF: '{{ [workflow.DATE_FIRST_CYCL[0:8], "0000 ", workflow.DATE_LAST_CYCL[0:8], "2300 06:00:00"]|join }}'
PROD_CYCLEDEF: "00 10,11,13,14,16,17,19,20,22,23 20-21 7 2022 *"
PRODLONG_CYCLEDEF: "00 9-23/3 20-21 7 2022 *"
#ARCHIVE_CYCLEDEF: '{{ [workflow.DATE_FIRST_CYCL[0:8], "0700 ", workflow.DATE_LAST_CYCL[0:8], "2300 24:00:00"]|join }}'
SPINUP_CYCLEDEF: "00 03-08,15-20 20-21 7 2022 *"
#gsi:
# HYBENSMEM_NMIN: 66
nco:
NET: rrfs
envir: para
model_ver: v1.0
RUN: RRFS_conus_3km
task_get_extrn_ics:
EXTRN_MDL_NAME_ICS: FV3GFS
FV3GFS_FILE_FMT_ICS: grib2
EXTRN_MDL_FILES_ICS:
- '{yy}{jjj}{hh}0000{fcst_hr:02d}'
EXTRN_MDL_ICS_OFFSET_HRS: 3
USE_USER_STAGED_EXTRN_FILES: true
EXTRN_MDL_SOURCE_BASEDIR_ICS: "/scratch2/BMC/zrtrr/rli/data/gfs/0p25deg/grib2"
task_get_extrn_lbcs:
EXTRN_MDL_NAME_LBCS: FV3GFS
FV3GFS_FILE_FMT_LBCS: grib2
EXTRN_MDL_FILES_LBCS:
- '{yy}{jjj}{hh}0000{fcst_hr:02d}'
LBC_SPEC_INTVL_HRS: 1
EXTRN_MDL_LBCS_OFFSET_HRS: 6
USE_USER_STAGED_EXTRN_FILES: true
EXTRN_MDL_SOURCE_BASEDIR_LBCS: "/scratch2/BMC/zrtrr/rli/data/gfs/0p25deg/grib2"
task_run_fcst:
DT_ATMOS: 60
RESTART_INTERVAL: 1
QUILTING: true
# IO_LAYOUT_Y: 1
# FH_DFI_RADAR: "0.0,0.25,0.5"
task_run_post:
USE_CUSTOM_POST_CONFIG_FILE: true
POST_OUTPUT_DOMAIN_NAME: RRFS_CONUS_3km
CUSTOM_POST_CONFIG_FP: '{{ [user.PARMdir, "upp/postxconfig-NT-fv3lam_rrfs.txt"]|path_join }}'
# CUSTOM_POST_PARAMS_FP: '{{ [user.PARMdir, "upp/params_grib2_tbl_new"]|path_join }}'
# TESTBED_FIELDS_FN: "testbed_fields_bgdawp.txt"
# TESTBED_FIELDS_FN2: "testbed_fields_bgrd3d.txt"
#task_process_radarref:
# RADARREFL_TIMELEVEL: [0]
#task_run_prdgen:
# ADDNL_OUTPUT_GRIDS: []
global:
DO_ENSEMBLE: false
NUM_ENS_MEMBERS: 9
HALO_BLEND: 20
PRINT_DIFF_PGR: true
rocoto:
tasks:
taskgroups: '{{ ["parm/wflow/coldstart.yaml", "parm/wflow/post.yaml"]|include }}'
metatask_run_ensemble:
task_run_fcst_mem#mem#:
walltime: 02:45:00
task_make_ics_mem#mem#:
nnodes: 3
ppn: 20
task_make_lbcs_mem#mem#:
walltime: 02:00:00
nnodes: 3
ppn: 20
metatask_run_ens_post:
metatask_run_post:
task_run_post_mem#mem#_f#fhr#:
nnodes: 1
ppn: 40
#task_run_ref2tten:
# ppn: 1
#task_run_nonvarcldanl:
# ppn: '{{ task_run_fcst.IO_LAYOUT_Y }}'
#task_run_anal:
# cores: 240 #anal
# cores: 80 #observer
Loading