Add options for Mixed Ensemble and Scale/Variable-Dependent Localization #451

shoyokota · 2022-11-30T17:03:16Z

DESCRIPTION OF CHANGES:

This PR is to apply "mixed global/regional ensembles (MixEn)" ( NOAA-EMC/GSI#451 ) and "scale/variable/time-dependent localization (SDL/VDL/TDL)" ( NOAA-EMC/GSI#460 ). The following 3 options are added.

l_both_fv3sar_gfs_ens (default: .false.)
- If it is ".true.", MixEn is activated with RRFS/EnKF (30 members) and GDAS/EnKF (80 members)
- In this MixEn, background error is simply added, so it is enlarged
nsclgrp (default: 1)
- If it is "2", SDL (2-scales) is activated
- Scale sepalation is done by recursive filter (exp(-0.5) length: 300km * sqrt(0.075))
- Horizontal localization exp(-0.5) length is 1200km * sqrt(0.075) (for larger scale) and 300km * sqrt(0.075) (for smaller scale)
- Vertical localization exp(-0.5) length is 1.1lnp * sqrt(0.075) for both larger and smaller scales
ngvarloc (default: 1)
- If it is "2", radar reflectivity is assimilated simultaneously with conventional data by pure EnVar with VDL
- In VDL, horizontal localization exp(-0.5) length becomes small as 15km * sqrt(0.075) only for w, qr, qs, qi, qg, ql, and dbz
- Cross-variable correlation is set to be zero (i_ensloccov4var=1) for now
assign_vdl_nml (default: .false.)
- If it is ".true.", another VDL option based on Wang and Wang (2023) is activated in the case of ngvarloc>1.

TESTS CONDUCTED:

I checked that the result was not changed compared to the workflow before this change in using "l_both_fv3sar_gfs_ens=.false.", "nsclgrp=1", and "ngvarloc=1" on Orion. I also checked that "l_both_fv3sar_gfs_ens=.true.", "nsclgrp=2", and "ngvarloc=2" accurately activated MixEn, SDL, and VDL, respectively.

DEPENDENCIES:

Following PRs should be merged to GSI used in this workflow

DOCUMENTATION:

ISSUE (optional):

To test this workflow on Orion, following modifications were required. I modified them also in this PR.

~~Copy of restart files not to be overwritten by the re-run of GSI analysis.~~ (removed from this PR for now)
~~Remove copy of nc_diag_cat.x and use ncdiag/1.0.0~~ (already modified by Ens fix 1210 #458)
Modify to use GDASENKF as IC/LBCs on Orion
~~Unify "walltime" and "maxtries" of HYBRID_RADAR_REF_TN and ANAL_GSI_TN~~ (already modified by workflow re-organization #454)

CONTRIBUTORS (optional):

Many people in OU, GSL, and EMC including Ting Lei contributed the work of MixEn and SDL/VDL/TDL.

hu5970 · 2022-11-30T22:30:28Z

scripts/exregional_run_analysis.sh

+      cp_vrfy ${bkpath}/fv_tracer.res.tile1.nc   ${bkpath}/bk_${ob_type}_fv_tracer.res.tile1.nc
+      cp_vrfy ${bkpath}/sfc_data.nc              ${bkpath}/bk_${ob_type}_sfc_data.nc
+      cp_vrfy ${bkpath}/phy_data.nc              ${bkpath}/bk_${ob_type}_phy_data.nc
+    fi


Prep_cyc builds the background and make a link to original background files (named as bk_*).
Why do we need to make a copy of the background files here again?

"bk_*" built in prep_cyc is just a link before doing "ncatted -a checksum". To keep the "ncatted" files, this copy process is required. On Orion, overwriting these files by GSI analysis is often failed and this job is automatically rerun. To prevent the duplicate overwriting in the rerun, I added this copy process.

I still cannot figure out why this part of copy needed?

In this job, restart files are overwritten. Therefore, if this job is failed after outputting restart files, updated restart files are used as the first guess of EnVar in the rerun job by accident. In fact, such situation frequently occurred on Orion. To prevent from that issue, I added this part.

hu5970 · 2023-02-03T15:35:55Z

@shoyokota Could you update and sync this PR with current RRFS_dev1 branch? Thanks, Ming

…ature/PR_NOAA-GSL_EnVar-SDL

shoyokota · 2023-02-07T21:52:23Z

@hu5970 I updated this PR with current RRFS_dev1 branch. I further modified it to be able to use NOAA-EMC/GSI#504. I conducted tests again and updated the "DESCRIPTION OF CHANGES".

hu5970 · 2023-02-07T23:18:10Z

fix/gsi/anavinfo.rrfs_all

@@ -0,0 +1,81 @@
+met_guess::


About the name of this file: should have a name fit to the application. Using "_all" is too general.

I renamed 'all' to 'conv_dbz'.

hu5970 · 2023-02-07T23:20:36Z

scripts/exregional_run_analysis.sh

+      cp_vrfy ${bkpath}/fv_tracer.res.tile1.nc   ${bkpath}/bk_${ob_type}_fv_tracer.res.tile1.nc
+      cp_vrfy ${bkpath}/sfc_data.nc              ${bkpath}/bk_${ob_type}_sfc_data.nc
+      cp_vrfy ${bkpath}/phy_data.nc              ${bkpath}/bk_${ob_type}_phy_data.nc
+    fi


I still cannot figure out why this part of copy needed?

hu5970 · 2023-02-07T23:21:35Z

scripts/exregional_run_analysis.sh

@@ -473,7 +501,7 @@ else
  esac
 fi

-if [[ ${gsi_type} == "OBSERVER" || ${ob_type} == "conv" ]]; then
+if [[ ${gsi_type} == "OBSERVER" || ${anav_type} == "conv" || ${anav_type} == "all" ]]; then


Using "all" as analysis variable is too general. As this application doing all the thing and cannot be extended?

I renamed 'all' to 'conv_dbz'.

hu5970 · 2023-02-07T23:25:47Z

ush/config.sh.RRFS_CONUS_13km

@@ -25,6 +25,40 @@ DO_SOIL_ADJUST="TRUE"
 DO_RADDA="FALSE"
 DO_BUFRSND="FALSE"

+l_both_fv3sar_gfs_ens=.false. #if true, ensemble size is increased with GDAS ensemble


This part is added in three configuration files: RRFS_CONUS_13km, RRFS_CONUS_3km, RRFS_CONUS_3km.2022HWT. If they are same or mostly same, can make a separate file just like
set_rrfs_config_general.sh and only include special setups in configure. You can also setup grid type related parameters in that file. Please let me know if you need more details on how to simplify this setups.

I made a separated file (set_rrfs_config_SDL_VDL_MixEn.sh) for setting of MixEn/SDL/VDL.

…fs_config_SDL_VDL_MixEn.sh

…ature/PR_NOAA-GSL_EnVar-SDL

shoyokota · 2023-02-21T17:02:28Z

@hu5970 I merged current feature/RRFS_dev1 branch to this PR. And I removed the copy of restart files not to increase the walltime. We need to think a better way to prevent from crashing restart files in another PR.

hu5970

Looks good

terraladwig · 2023-02-24T19:37:07Z

ush/set_rrfs_config_SDL_VDL_MixEn.sh

+l_both_fv3sar_gfs_ens=.false. #if true, ensemble size is increased with GDAS ensemble (MixEn)
+nsclgrp=1                     #number of scales for scale-dependent localization (SDL)
+ngvarloc=1                    #number of scales for variable-dependent localization (VDL)
+assign_vdl_nml=.false.        #if true, vdl_scale and vloc_varlist are used to set VDL


@shoyokota Should lines 2,3,4,5 be removed from this file? Since these options are set in config_defaults.sh, repeating them here overwrites what is set and requires this file to be changed to turn on/off the options.

Overwriting these options in set_rrfs_config_SDL_VDL_MixEn.sh is as I expect and removing them is not required. (A lot of options set in config_defaults.sh are already overwritten in set_rrfs_config.sh and set_rrfs_config_general.sh.) If you would like to change these options, please change set_rrfs_config_SDL_VDL_MixEn.sh (not config_defaults.sh).

…ion (NOAA-GSL#451) * Add options for Scale/Variable/Time-Dependent Localization * Add options for Variable-Dependent Localization of OU/MAP * rename 'all' to 'conv_dbz' and separate configuration files to set_rrfs_config_SDL_VDL_MixEn.sh * remove change for preventing from crashing restart files for now --------- Co-authored-by: Sho Yokota <syokota@Orion-login-1.HPC.MsState.Edu>

Add options for Scale/Variable/Time-Dependent Localization

4fda327

shoyokota requested review from christinaholtNOAA, chunhuazhou, CurtisAlexander-NOAA, hu5970, JeffBeck-NOAA, terraladwig, TrevorAlcott-NOAA, guoqing-noaa and daviddowellNOAA as code owners November 30, 2022 17:03

shoyokota changed the title ~~Add options for Scale/Variable/Time-Dependent Localization~~ Add options for Mixed Ensemble and Scale/Variable-Dependent Localization Nov 30, 2022

Merge branch 'feature/RRFS_dev1' into feature/PR_NOAA-GSL_EnVar-SDL

b46f252

hu5970 reviewed Dec 1, 2022

View reviewed changes

Sho Yokota added 2 commits February 7, 2023 15:12

Merge remote-tracking branch 'upstream_gsl/feature/RRFS_dev1' into fe…

91791b2

…ature/PR_NOAA-GSL_EnVar-SDL

Add options for Variable-Dependent Localization of OU/MAP

e81c805

hu5970 reviewed Feb 7, 2023

View reviewed changes

Sho Yokota added 3 commits February 9, 2023 12:08

rename 'all' to 'conv_dbz' and separate configuration files to set_rr…

c6084ab

…fs_config_SDL_VDL_MixEn.sh

remove change for preventing from crashing restart files for now

10d6c2a

Merge remote-tracking branch 'upstream_gsl/feature/RRFS_dev1' into fe…

2f6fdef

…ature/PR_NOAA-GSL_EnVar-SDL

hu5970 approved these changes Feb 21, 2023

View reviewed changes

hu5970 merged commit 2f088cd into NOAA-GSL:feature/RRFS_dev1 Feb 21, 2023

terraladwig reviewed Feb 24, 2023

View reviewed changes

MichaelLueken mentioned this pull request Apr 5, 2023

[develop] Add new RRFS variables such as NWGES and workflow control variables ufs-community/ufs-srweather-app#647

Closed

37 tasks

shoyokota mentioned this pull request Jun 1, 2023

Modification to assimilate radar reflectivity simultaneously with the conventional data and to tune weights of mixed ensemble in EnVar #533

Merged

shoyokota mentioned this pull request Jun 14, 2023

fix anavinfo.rrfs_conv_dbz to assimilate radar reflectivity in hybrid-EnVar #535

Merged

shoyokota mentioned this pull request Nov 27, 2023

Fix anavinfo not to use vertical velocity for CRTM #595

Closed

shoyokota mentioned this pull request Feb 5, 2024

Add variable DO_ENVAR_RADAR_REF_ONCE with brief description to RRFS CONUS config file NOAA-EMC/rrfs-workflow#223

Closed

16 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add options for Mixed Ensemble and Scale/Variable-Dependent Localization #451

Add options for Mixed Ensemble and Scale/Variable-Dependent Localization #451

shoyokota commented Nov 30, 2022 •

edited

Loading

hu5970 Nov 30, 2022

shoyokota Dec 1, 2022

hu5970 Feb 7, 2023

shoyokota Feb 9, 2023

hu5970 commented Feb 3, 2023

shoyokota commented Feb 7, 2023

hu5970 Feb 7, 2023

shoyokota Feb 9, 2023

hu5970 Feb 7, 2023

hu5970 Feb 7, 2023

shoyokota Feb 9, 2023

hu5970 Feb 7, 2023

shoyokota Feb 9, 2023

shoyokota commented Feb 21, 2023

hu5970 left a comment

terraladwig Feb 24, 2023

shoyokota Feb 24, 2023

Add options for Mixed Ensemble and Scale/Variable-Dependent Localization #451

Add options for Mixed Ensemble and Scale/Variable-Dependent Localization #451

Conversation

shoyokota commented Nov 30, 2022 • edited Loading

DESCRIPTION OF CHANGES:

TESTS CONDUCTED:

DEPENDENCIES:

DOCUMENTATION:

ISSUE (optional):

CONTRIBUTORS (optional):

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

hu5970 commented Feb 3, 2023

shoyokota commented Feb 7, 2023

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

shoyokota commented Feb 21, 2023

hu5970 left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

shoyokota commented Nov 30, 2022 •

edited

Loading