Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GSI speedup, add the fix/ directory, bug fixes and others #2

Merged
merged 7 commits into from
Sep 20, 2021

Conversation

guoqing-noaa
Copy link
Collaborator

< Changes here are mainly reflected by hash updates for different components >

use 2 OMP threads, kjet specific optimization and parallel netcdf to speed up GSI run
change cp_vrfy to ln_vrfy for GSI jobs
changes in FV3LAM namelist
add $HYBENSMEM_NMIN which sets the minimum number of ensembles required for a hybrid GSI analysis
more control on wgrib2 jobs
clean up outdated variables in exregional_run_analysis.sh
turn off l2rw DA through gsiparm.anl
update devbuild.sh to be able to determine HPC platforms automatically
bug fixes on rrfs_utl, pygraf, gsi, etc.

Add the fix/ directory to regional_workflow

  • GSI fix files under fix/gsi
  • UPP fix files under fix/upp
  • CRTM fix files under fix/crtm
  • change scripts, config.sh*, etc accordingly

Add Init.sh

  • initialize fix/ so that links to binary/large fix files work at different HPC platforms
  • install pre-commit git hook to prevent binary/large fix files themselves to be committed

Add fix_rrfs_locations.sh

  • set the FIX_RRFS locations at differnt HPC platforms

AIRCRAFT_REJECT, SFCOBS_USELIST

  • default to use fix files under FIX_GSI unless a path specified in config.sh

Add $TESTBED_FIELDS_FN (files are under FIX_UPP)

  • different testbed_fields files for different applications
  • if empty string, no bgsfc output

  add parallel-netcdf capability to speed up writing out FV3LAM final analysis
  kjet specific optimization
update ufs_weather_model
  be able use latest fv3lam namelist
update rrfs_utl
bug fix in manage_externals
update devbuild.sh
    determine HPC platforms automatically

 -- by the GSL RRFS/RTMA development team
@guoqing-noaa
Copy link
Collaborator Author

For information, relevant PRs to different components:

regional_workflow: NOAA-GSL/regional_workflow#210
GSI: NOAA-GSL/GSI#4

Copy link
Collaborator

@cshartsough cshartsough left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, nothing to comment on. Thanks.

Copy link
Collaborator

@EdwardColon-NOAA EdwardColon-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good but wcoss2 will need to be added to the machine-specific options at some point in devbuild.sh.

Copy link
Collaborator

@AnnetteGibbs-NOAA AnnetteGibbs-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@guoqing-noaa guoqing-noaa merged commit 3009266 into ufs-community:develop Sep 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants