Add option to use netcdf quantization

[DusanJovic-NOAA]

PR Author Checklist:

• I have linked PR's from all sub-components involved in section below.

• I am confirming reviews are completed in ALL sub-component PR's.

• I have run the full RT suite on either Hera/Cheyenne AND have attached the log to this PR below this line:

  • LOG:
    RegressionTests_hera.log

• I have added the list of all failed regression tests to "Anticipated changes" section.

• I have filled out all sections of the template.

Description

This PR adds new configuration parameters which can be used to enable the netcdf quantization (lossy compression)
Two new (optional) model_configure parameters are: quantize_mode, quantize_nsd. The quantize_mode is a string which can have values 'quantize_bitgroom', 'quantize_granularbr' or 'quantize_bitround'., and quantize_nsd is number of significant digits. See documentation here.

Linked Issues and Pull Requests

Associated UFSWM Issue to close

Closes #1929
Closes #1575
Closes #1615

Subcomponent Pull Requests

NOAA-EMC/fv3atm/pull/718

Blocking Dependencies

Subcomponents involved:

• AQM
• CDEPS
• CICE
• CMEPS
• CMakeModules
• FV3
• GOCART
• HYCOM
• MOM6
• NOAHMP
• WW3
• stochastic_physics
• none

Anticipated Changes

Input data

• No changes are expected to input data.
• Changes are expected to input data:
  • New input data.
  • Updated input data.

Regression Tests:

• No changes are expected to any regression test.
• Changes are expected to the following tests:

Tests effected by changes in this PR:

• control_wrtGauss_netcdf_parallel
• control_wrtGauss_netcdf_parallel_debug

Libraries

• Not Needed
• Needed
  • Create separate issue in JCSDA/spack-stack asking for update to library. Include library name, library version.
  • Add issue link from JCSDA/spack-stack following this item

Code Managers Log

• This PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR.
• Move new/updated input data on RDHPCS Hera and propagate input data changes to all supported systems.
  • N/A

Testing Log:

• RDHPCS
  • Hera
  • Orion
  • Hercules
  • Jet
  • Gaea
  • Cheyenne
• WCOSS2
  • Dogwood/Cactus
  • Acorn
• CI
  • Completed
• opnReqTest
  • N/A
  • Log attached to comment

[BrianCurtis-NOAA]

@DusanJovic-NOAA The RegressionTests_Hera.log you have shows comparison against your own REGRESSIONTESTS directory. Do you have one that shows the two tests failing against develop baselines?

[DusanJovic-NOAA]

RegressionTests_hera.log

Hera log file against current baseline.

[jkbk2004]

@DusanJovic-NOAA We can start working on this pr. If you are available, can you sync up branch?

[jkbk2004]

Regression tests run ok with this pr on RDHPCS sides. @BrianCurtis-NOAA @junwang-noaa FYI

[BrianCurtis-NOAA]

Regression tests run ok with this pr on RDHPCS sides. @BrianCurtis-NOAA @junwang-noaa FYI

All set for WCOSS2 Systems

[epic-cicd-jenkins]

Jenkins-ci ORTs passed

[zach1221]

The baselines create fine, but I continue to receive failures on Hercules when attempting to match against the atmf000.nc file, on Hercules.

[jkbk2004]

File are identical. It's nccmp hiccups. If I keep submitting those two failed cases, They run and compare ok. I think random system behavior.

[jkbk2004]

We will monitor the functionality of nccmp on hercules in coming PRs. BTW, we can move on to merge this pr.

[zach1221]

@DusanJovic-NOAA fv3atm PR #718 has been merged. Please revert changes to the git module url and update the fv3atm hash.
Hash: NOAA-EMC/fv3atm@65c6017

[DusanJovic-NOAA]

The baselines create fine, but I continue to receive failures on Hercules when attempting to match against the atmf000.nc file, on Hercules.

Can you please copy/paste text next time instead of screenshot image.