Need ESMF_8_1_1_beta_snapshot_01 for testing

[theurich]

Is your feature request related to a problem? Please describe.
Jun Wang and Moorthi Shrinivas reported performance issues with ESMF_8_1_0_beta_snapshot_47 when used with threaded model execution. This might be an ESMF regression that went also out with the official 8.1.0 release. To test this hypothesis, we have prepared a new snapshot for a patch release ESMF_8_1_1_beta_snapshot_01, that needs to be tested.

Describe the solution you'd like
ESMF_8_1_1_beta_snapshot_01 installed as part of hpc-stack on those platforms that Jun and Moorthi are doing their testing. Will need input from them.

Additional context
The snapshot is accessible at https://github.com/esmf-org/esmf/releases/tag/ESMF_8_1_1_beta_snapshot_01

[junwang-noaa]

nceplibs team, would you please install this snapshot in hpc/1.1.0 on hera and dell for us to do some testing? Thank you!

[edwardhartnett]

@Hang-Lei-NOAA can you please treat this issue as urgent?

[Hang-Lei-NOAA]

yes, will do it today

…

On Thu, Apr 15, 2021 at 4:57 PM Edward Hartnett ***@***.***> wrote: @Hang-Lei-NOAA <https://github.com/Hang-Lei-NOAA> can you please treat this issue as urgent? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#208 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKWSMFGYAC6ESBSPOR5TYKTTI5HLXANCNFSM426MX6XA> .

[Hang-Lei-NOAA]

It has been installed on WCOSS-dell. But cannot be installed on hera today, because of " : Disk quota exceeded" On Thu, Apr 15, 2021 at 5:02 PM Hang Lei - NOAA Affiliate ***@***.***> wrote:

…

yes, will do it today On Thu, Apr 15, 2021 at 4:57 PM Edward Hartnett ***@***.***> wrote: > @Hang-Lei-NOAA <https://github.com/Hang-Lei-NOAA> can you please treat > this issue as urgent? > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <#208 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AKWSMFGYAC6ESBSPOR5TYKTTI5HLXANCNFSM426MX6XA> > . >

[junwang-noaa]

Thanks to Rahul's help, the ESMF_8_1_1_beta_snapshot_01 was installed under emc.nemspara on hera at:

/scratch1/NCEPDEV/nems/emc.nemspara/soft/esmf/tmp/intel-18.0.5.274/impi-2018.0.4/esmf/8_1_1_beta_snapshot_01

to use it in ufs-weather-model, following changes are needed:

1. ufs-weather-model/modulefiles/ufs-common

#module load esmf/8_1_0_beta_snapshot_47

2. in ufs-weather-model/modulefiles/ufs_hera.intel, add a line :

module load ufs_common
setenv ESMFMKFILE "/scratch1/NCEPDEV/nems/emc.nemspara/soft/esmf/tmp/intel-18.0.5.274/impi-2018.0.4/esmf/8_1_1_beta_snapshot_01/lib/esmf.mk"

[SMoorthi-emc]

Can someone tell me where this ESMF is installed on Wcoss-Dell?
I don't see the path listed here.
Thanks
Moorthi

[Hang-Lei-NOAA]

It is installed through the hpc-stack: To try EMC installation on WCOSS-dell: %module use /usrx/local/nceplibs/dev/hpc-stack/libs/hpc -stack/modulefiles/stack %module load hpc/1.1.0 %module load hpc-ips/18.0.1.163 %module load hpc-impi/18.0.1 %module avail --------------------------------------------------------------------------------- /gpfs/dell2/usrx/local/nceplibs/dev/hpc-stack/libs/hpc -stack/modulefiles/mpi/ips/18.0.1.163/impi/18.0.1 ------------------------------------------------------------------ atlas/jcsda-release-stable esmf/8_1_0_beta_snapshot_36-debug fckit/jcsda-release-stable nccmp/1.8.7.0 nemsiogfs/2.5.3 upp/10.0.0 upp/10.0.4 wrf_io/1.1.1 eckit/jcsda-release-stable esmf/8_1_0_beta_snapshot_36 fms/noaa-gfdl-main nceppost/dceca26 netcdf/4.7.4 upp/10.0.1 upp/10.0.5 esmf/8_1_0_beta_snapshot_27-debug esmf/8_1_0_beta_snapshot_47-debug fms/noaa-gfdl-2020.04.03 ncio/1.0.0 pio/2.5.1 upp/10.0.2 w3emc/2.7.3 esmf/8_1_0_beta_snapshot_27 esmf/8_1_0_beta_snapshot_47 hdf5/1.10.6 nemsio/2.5.2 pio/2.5.2 upp/10.0.3 wgrib2/2.0.8

…

--------------------------------------------------------------------- /gpfs/dell2/usrx/local/nceplibs/dev/hpc-stack/libs/hpc -stack/modulefiles/compiler/ips/18.0.1.163 ---------------------------------------------------------------------- bacio/2.4.1 crtm/2.3.0 g2c/1.6.2 gfsio/1.4.1 hpc-impi/18.0.1 (L) ip2/1.1.2 jasper/2.0.25 landsfcutil/2.4.1 prod_util/1.2.2 sigio/2.3.2 szip/2.1.1 w3nco/2.4.1 bufr/11.4.0 g2/3.4.1 g2tmpl/1.9.1 grib_util/1.2.2 ip/3.3.3 jasper/2.0.22 jpeg/9.1.0 png/1.6.35 sfcio/1.4.1 sp/2.3.3 udunits/2.2.26 zlib/1.2.11

On Mon, Apr 19, 2021 at 7:44 PM SMoorthi-emc ***@***.***> wrote: Can someone tell me where this ESMF is installed on Wcoss-Dell? I don't see the path listed here. Thanks Moorthi — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#208 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKWSMFDKBYCPRIL6M2UEP5TTJS56HANCNFSM426MX6XA> .

[SMoorthi-emc]

Hi hang, I don't see "esmf/8_1_1_beta_snapshot_01" in the above list.

[Hang-Lei-NOAA]

Hi Dr. Moorthi, It should be there when you follow the command line. I just copied part of results. Thanks Hang

…

On Mon, Apr 19, 2021 at 7:59 PM SMoorthi-emc ***@***.***> wrote: Hi hang, I don't see "esmf/8_1_1_beta_snapshot_01" in the above list. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#208 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKWSMFATR6ON2QWFRVTQ5ALTJS7WLANCNFSM426MX6XA> .

[junwang-noaa]

@SMoorthi-emc Do you need more testing?
@theurich If all the testing is done, we are OK to install this version on all the platforms or you will give us a new version?

[SMoorthi-emc]

Jun, I am quite satisfied. All my runs were ok. Thanks Moorthi

…

On Tue, Apr 20, 2021 at 10:49 AM Jun Wang ***@***.***> wrote: @SMoorthi-emc <https://github.com/SMoorthi-emc> Do you need more testing? @theurich <https://github.com/theurich> If all the testing is done, we are OK to install this version on all the platforms or you will give us a new version? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#208 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALLVRYWUGDRAC2GC4FCVBRTTJWH6PANCNFSM426MX6XA> .

-- Dr. Shrinivas Moorthi Research Meteorologist Modeling and Data Assimilation Branch Environmental Modeling Center / National Centers for Environmental Prediction 5830 University Research Court - (W/NP23), College Park MD 20740 USA Tel: (301)683-3718 e-mail: ***@***.*** Phone: (301) 683-3718 Fax: (301) 683-3718

[edwardhartnett]

@theurich is there any way our CMake build can tell one snapshot release from another? Apparently their version is all the same?

[kgerheiser]

To add to what @edwardhartnett said. I ran ESMF_Info and it gives ESMF_VERSION_STRING: 8.1.0 beta snapshot, but with no associated number.

[theurich]

@junwang-noaa - There will be a new version. The 811bs01 was just a quickly modified version to verify that what I was suspecting was indeed the culprit. We will have a 811bs02 shortly, with a few other fixes that we want to push out into the 8.1.1 patch release. I will let you know when 811bs02 is available. Once that has been tested on your side, we are ready to push the official 8.1.1 patch release.

[theurich]

@edwardhartnett @kgerheiser the ESMF_PrinInfo reports:

ESMF_PrintInfo

   ESMF_VERSION_STRING:       8.1.1 beta snapshot

   ESMF_VERSION_MAJOR:                   8
   ESMF_VERSION_MINOR:                   1
   ESMF_VERSION_REVISION:                1
   ESMF_VERSION_PATCHLEVEL:              1
   ESMF_VERSION_PUBLIC:        F
   ESMF_VERSION_BETASNAPSHOT:  T

 I/O feature support enabled:
   ESMF_IO_NETCDF_PRESENT      T
   ESMF_IO_PIO_PRESENT         T
   ESMF_IO_PNETCDF_PRESENT     F