Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[INSTALL] Install the libraries for ufs-weather-model develop branch on wcoss2 #432

Open
junwang-noaa opened this issue Apr 13, 2022 · 17 comments
Open

[INSTALL] Install the libraries for ufs-weather-model develop branch on wcoss2 #432

junwang-noaa opened this issue Apr 13, 2022 · 17 comments
Assignees
@kgerheiser @jkbk2004 @Hang-Lei-NOAA

Comments

@junwang-noaa
Copy link

Note: Please search to see if an issue already exists for the software you are requesting to be installed.

Which software in the stack would you like installed?
Please install the libraries on wcoss2 to support ufs-weather-model develop branch.

What is the version/tag of the software?
jasper/2.0.22
png/1.6.35
pio/2.5.2
esmf/8.3.0b09
esmf/8.3.0b09-debug
fms/2022.01
g2/3.4.2
gftl-shared/v1.3.3
yafyaml/v0.5.1
mapl/2.11.0-esmf-8.3.0b09

What compilation options would you like set?
Give a detailed list of compilation options, compiler and MPI flavors and versions, etc.

Which machines would you like to have the software installed?
wcoss2

Any other relevant information that we should know to correctly install the software??
Please describe in as much detail as possible.

Additional context
Add any other context or screenshots about the install request here.
@kgerheiser
Copy link
Contributor

kgerheiser commented Apr 13, 2022 •
edited
Loading

FMS needs a newer version. 2021.04 is the latest.

ESMF is available. Installed in /para right now (along with FMS 2021).

export HPC_OPT=/apps/ops/para/libs
module use /apps/ops/para/libs/modulefiles/compiler/intel/19.1.3.304/
module use /apps/ops/para/libs/modulefiles/mpi/intel/19.1.3.304/cray-mpich/8.1.7/
module load intel craype cray-mpich/8.1.7

module load esmf/8.3.0b09

PIO and MAPL (along with associated dependencies) are being reviewed.

And for some of these could we update the develop branch to use jasper/2.0.25, g2/3.4.5, and libpng/1.6.37?

Jasper and g2 are already available everywhere. And we can add libpng/1.6.37 to hpc-stack installations.

@junwang-noaa
Copy link
Author

@kgerheiser Thank you very much for the information, please let us know when libpng/1.6.37 is available, we can use fms/2021.04 for testing now, but since we are moving to fms 2022.01 this week, so we will need it when updating ufs-weather-model with wcoss2 porting change.

@DusanJovic-NOAA FYI.

@jkbk2004
Copy link

@junwang-noaa @kgerheiser I agree to merge in fms2022.01 PR first. Then we can address other updates: libpng, hdf5, netcdf.

@kgerheiser
Copy link
Contributor

@junwang-noaa I'll see about getting 2022.01 installed on WCOSS2.

@jkbk2004 yes, that's fine. There are no HDF5/NetCDF updates though.

I think UFS should be updated to use newer g2 (3.4.5), Jasper (2.0.25), PIO (2.5.3), libpng (1.6.37) in the near future, and then they'll be the more up-to-date and consistent with what WCOSS2 already has, and our stack builds by default.

I would expect no differences when using these newer versions.

@WenMeng-NOAA
Copy link

@arunchawla-NOAA @kgerheiser I would like to get some clarifications. The NCEPlibs installed under /apps/ops/para/libs/modulefiles/mpi/intel/19.1.3.304/cray-mpich/8.1.7 and /apps/ops/para/libs/modulefiles/compiler/intel/19.1.3.304 would support porting ufs-weather-model and UPP develop branch on WCOSS2? These libs are installed at dev site maintained by EIB?

@DusanJovic-NOAA
Copy link
Contributor

@junwang-noaa I'll see about getting 2022.01 installed on WCOSS2.

@jkbk2004 yes, that's fine. There are no HDF5/NetCDF updates though.

I think UFS should be updated to use newer g2 (3.4.5), Jasper (2.0.25), PIO (2.5.3), libpng (1.6.37) in the near future, and then they'll be the more up-to-date and consistent with what WCOSS2 already has, and our stack builds by default.

I would expect no differences when using these newer versions.

Ok. Please make sure g2 (3.4.5), Jasper (2.0.25), PIO (2.5.3), libpng (1.6.37) are installed everywhere and we'll update UFS.

@DusanJovic-NOAA
Copy link
Contributor

/apps/ops/para/libs/modulefiles/stack is empty.

@junwang-noaa junwang-noaa mentioned this issue Apr 15, 2022
Closed
@junwang-noaa
Copy link
Author

@KyleNevins-NOAA May I ask if libpng/1.6.37 is available on wcoss2 now? Also, please see the message from Dusan: "/apps/ops/para/libs/modulefiles/stack is empty."

@DusanJovic-NOAA
Copy link
Contributor

@kgerheiser Is there a plan to install hpc-stack in /apps/ops/para/libs such that we can:

module use /apps/ops/para/libs/modulefiles/stack

module load hpc/1.2.0
module load hpc-intel/19.1.3.304
module load hpc-cray-mpich/8.1.7

In the above comment you suggested that we update pio to 2.5.3, but that version is not available. Any updates on gftl-shared, yafyaml and mapl? Also 8.3.0b09-debug is missing.

General question, will this location (/apps/ops/para/libs/) hold all hpc-stack libraries required by the ufs-weather-model, as on any other supported platform? Or just a subset?

@WenMeng-NOAA
Copy link

I echo @DusanJovic-NOAA 's suggestion. From our UPP perspective, it would be better to use libs from hpc-stack for UPP develop branch.

@Hang-Lei-NOAA
Copy link
Contributor

Hang-Lei-NOAA commented Apr 20, 2022 via email

@DusanJovic-NOAA
Copy link
Contributor

DusanJovic-NOAA commented Apr 20, 2022 •
edited
Loading

That is not the NCO's way. They only use hpc-stack for the installation, and then copy, move into their structure.

@Hang-Lei-NOAA Are you saying that libraries in /apps/ops/para/libs are not installed by the hpc-stack team (nceplibs team)?

@arunchawla-NOAA
Copy link

NCO uses hpc-stack but installs by themselves. Right now pio is going through NCO review, as soon as that is done it will be installed. After that the NASA libraries will be installed. Once pio is there will you be able to test the ufs-weather-model build ? Not withstanding the gocart related libraries

@DusanJovic-NOAA
Copy link
Contributor

Is somebody from NCO looking at this issue?

@edwardhartnett
Copy link
Contributor

The ufs-weather-model build uses PIO?

@Hang-Lei-NOAA
Copy link
Contributor

Hang-Lei-NOAA commented Apr 20, 2022 via email

@arunchawla-NOAA
Copy link

@DusanJovic-NOAA yes, @edwardhartnett yes pio is used by cmeps and esmf also now

@DusanJovic-NOAA DusanJovic-NOAA mentioned this issue May 16, 2022
Merged
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kgerheiser kgerheiser

@jkbk2004 jkbk2004

@Hang-Lei-NOAA Hang-Lei-NOAA

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@kgerheiser @junwang-noaa @jkbk2004 @edwardhartnett @Hang-Lei-NOAA @DusanJovic-NOAA @WenMeng-NOAA @arunchawla-NOAA