Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release/public v2 gaea update #830

Conversation

natalie-perlin
Copy link
Collaborator

This update is for backward compatibility with the SRW release/public-v2 branch of the SRW App,
https://github.com/ufs-community/ufs-srweather-app.git.

Changes are made to reflect updates in Lmod/8.7.12, miniconda3, and the hpc-stack on Gaea NOAA HPC system, installed under epic.role account in /lustre/f2/dev/wpo/role.epic/contrib/ space, and maintained by EPIC.

** FILES CHANGED

The following scripts have been changed under the ./regional_workflow/ base directory:

./ush/machine/gaea.sh
./ush/load_modules_run_task.sh (contribution of @EdwardSnyder-NOAA )
./modulefiles/module-setup.sh.inc
./modulefiles/module-setup.csh.inc
./modulefiles/tasks/gaea/make_grid.local, get_extrn_ics.local, get_extrn_lbcs.local, make_orog.local, make_sfc_climo.local, make_ics.local, make_lbcs.local, run_fcst.local, run_post.local (contribution of @EdwardSnyder-NOAA )

** TESTING PERFORMED

The updated repository has been tested on Gaea as a part of the SRW release/public-v2 branch,
by specifying the url for the regional_workflow in the Externals.cfg as following:

[regional_workflow]
protocol = git
#repo_url = https://github.com/ufs-community/regional_workflow
repo_url = https://github.com/natalie-perlin/regional_workflow
# Specify either a branch name or a hash but not both.
branch = release/public-v2-gaea-update
local_path = regional_workflow
required = True
...

Additional files in the SRW release/public-v2 branch were modified to sync the updated Lmod/8.7.12, miniconda3/4.12.0 and the hpc-stack initialization, under the main SRW directory, such as ./ufs-srweather-app/:

./etc/lmod-setup.sh , lmod-setup.csh
./modulefiles/build_gaea_intel
./modulefiles/wflow_gaea

These updates of the SRW release/public-v2 branch are being prepared as a separate PR into the
https://github.com/ufs-community/ufs-srweather-app.git, to correspond the current changes to the regional_workflow repo, release/public-v2 branch.

The SRW has been build, and a test case grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16 from the comprehensive test suite has been run using the rocoto and crontab table. The following stages have been successfully completed:
make_grid
make_orog
make_sfc_climo
get_extrn_ics
get_extrn_lbcs
make_ics
make_lbcs
run_fcst
run_post_f001 - run_post_f006.

Added new (Lmod/8.7.12) initialization wrapper script to the ENV_INIT_SCRIPTS_FPS variable; 
added the PROJ_LIB and PATH variables referring to a PROJ package location in the updated miniconda3/4.12.0 and the regional_workflow environment that contain the PROJ package
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/.
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Updates to the MetPlus verification script; not yet officially supported in the release of public-v2. These changes and test of the MetPlus script were done by @EdwardSnyder-NOAA
A bug found by @EdwardSnyder-NOAA; a separate PR to be created into the develop branch
Specify a new location of the miniconda3/4.12.0 with the regional_workflow environment containing all the necessary packages, and the rocoto/1.3.3 module installed on Gaea under EPIC role account: /lustre/f2/dev/wpo/role.epic/contrib/
Copy link
Collaborator

@EdwardSnyder-NOAA EdwardSnyder-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The get_extrn_lbcs.local file under gaea (modulefiles/tasks/get_extrn_lbcs.local) needs to removed. It should go under: modulefiles/tasks/gaea/get_extrn_lbcs.local, which you have already.

Copy link
Collaborator

@panll panll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tested it on Hera, and it works fine.

A redundant module; it is placed under ./regional_workflow/modulefiles/tasks/gaea/ instead.
Copy link
Collaborator Author

@natalie-perlin natalie-perlin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed a redundant module placed under ./regional_workflow/modulefiles/tasks/

@natalie-perlin
Copy link
Collaborator Author

@EdwardSnyder-NOAA - the repo has been updated, a redundant file has been removed!

Updated following recent tests of Met verification, as in ufs-srweather-app repository PR-353: ufs-community/ufs-srweather-app#353
Updated Met Installation locations on Gaea
@natalie-perlin natalie-perlin merged commit fd233fd into ufs-community:release/public-v2 Sep 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants