-
Notifications
You must be signed in to change notification settings - Fork 136
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CIME update needed for running the pumas codes on GPU and introduce a GPU regression test suite #512
Comments
@sjsprecious - It sounds like changes need to be made in cime and/or ccs_config_cesm? If so, those changes need to be made and tested in CESM and tagged. Once a CESM alpha tag has been made with these changes, please open a PR that contains these updated externals. If this update requires code changes in CAM as well, then we'll need to coordinate the changes. Right now the latest cime tag I see is cime6.0.13 and the ccs_config tag is ccs_config_cem0.0.4. |
Thanks @cacraigucar and yes, changes are needed in cime and ccs_config_cesm. I will do what you suggested on the cime side first and bring in those tags in my CAM PR later. |
After the PUMAS tag v1.22 is brought into CAM, some source code names are changed (ESCOMP/CAM#512). Therefore, the system configuration file needs to be updated correspondingly in order to apply the GPU flags to the right files. In addition, the NVHPC compiler and its related modules on Casper are updated to the latest and compatible versions.
@sjsprecious I just wanted to let you know that #513 has been tagged. This brings in cime6.0.13 and introduces the ccs_config external ccs_config_cesm0.0.4 . I believe you indicated you will need mods beyond these which is why I left this issue open. |
@cacraigucar , thanks a lot for your help. I have addressed this issue in this PR (ESMCI/ccs_config_cesm#8) but there is a runtime error of using NUOPC driver with the NVHPC compiler and OpenMPI lib. Jim and I are working on this issue right now and I will update it here once the issue is resolved. On the other hand, this tag (https://github.com/ESMCI/ccs_config_cesm/tree/ccs_config_cesm0.0.6) works fine with MCT driver and nvhpc/openmpi on Casper. |
Hi @cacraigucar , the NVHPC and ESMF lib version have been updated to resolve a runtime error in CAM with NUOPC driver. The PR is accepted (ESMCI/ccs_config_cesm#22) and tagged (ccs_config_cesm0.0.22). Could you please help brought this tag into CAM or do you want me to open a PR first? I expect this change is BFB on Cheyenne since there is no change related to it. Thanks! |
@sjsprecious - Is there an immediate need for this? We typically update our externals to match CESM externals when a new CESM beta tag is made. The next CESM beta tag may be a while. |
@cacraigucar , thanks for your reply. I do not have an immediate need for this, but just want to give you an update since this issue has been here for a while. It is fine for me to wait for the next CESM beta tag. How long will it usually take? |
We need a new ccs_config_cesm tag much sooner anyway to resolve issues with the port to NUOPC testing and CICE6 so I think this update will happen sooner (in the next week or two). |
Thanks @gold2718, that will be great! |
In the PR #409 , the pumas codes with tag
v1.22
will be brought in and it includes the file name changes frommicro_mg3_0.F90
tomicro_pumas_v1.F90
(ESCOMP/PUMAS@9c56241).Thus the CIME codes (or https://github.com/ESMCI/ccs_config_cesm for CIME tag later than
cime6.0.13
) need to be updated so that they applies the GPU flags to the correct source codes.In addition, the CICE5/CICE6/ccs_config modules need to be updated correspondingly before we could introduce a GPU regression test suite
The text was updated successfully, but these errors were encountered: