Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PLATFORM 989/PLATFORM 1000 - Develop a label (manual) triggered pipeline based on CM team's approval of UFS-WM. New and improved, now with parallelization. (Combined PR 2057 and PR 2039) #2017

Closed

Conversation

kbooker79
Copy link
Contributor

@kbooker79 kbooker79 commented Nov 29, 2023

…ssion testing in parallel.

PR Author Checklist:

  • I have linked PR's from all sub-components involved in section below.
  • I am confirming reviews are completed in ALL sub-component PR's.
  • I have run the full RT suite on either Hera/Cheyenne AND have attached the log to this PR below this line:
    • LOG:
  • I have added the list of all failed regression tests to "Anticipated changes" section.
  • I have filled out all sections of the template.

Description

This pull request, instantiates Jenkins CI/CD against NOAA on-prem Tier1 platforms based on Github labels attached to the PR (i.e. hera-RT, or jet-BL). The test baselines are updated based on the label. If a Tier1 system contains a label with -BL is selected, new baselines are created before the regression tests are run. Notifications are sent to the appropriate channel on the EPIC Slack workspace. This is an update on PR-1988 and allows multiple tier-1 platforms to be ran at once and includes a gate for Sonarqube testing.

Commit Message

Feature...Instantiates Jenkins CI/CD regression tests against various NOAA on-prem Tier-1 platforms.

Linked Issues and Pull Requests

Associated UFSWM Issue to close

Closes #2067

Subcomponent Pull Requests

Blocking Dependencies

Subcomponents involved:

  • AQM
  • CDEPS
  • CICE
  • CMEPS
  • CMakeModules
  • FV3
  • GOCART
  • HYCOM
  • MOM6
  • NOAHMP
  • WW3
  • stochastic_physics
  • none

Anticipated Changes

Input data

  • No changes are expected to input data.
  • Changes are expected to input data:
    • New input data.
    • Updated input data.

Regression Tests:

  • No changes are expected to any regression test.
  • Changes are expected to the following tests:
Tests effected by changes in this PR:

Libraries

  • Not Needed
  • Needed
    • Create separate issue in JCSDA/spack-stack asking for update to library. Include library name, library version.
    • Add issue link from JCSDA/spack-stack following this item
Code Managers Log
  • This PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR.
  • Move new/updated input data on RDHPCS Hera and propagate input data changes to all supported systems.
    • N/A

Testing Log:

  • RDHPCS
    • Hera
    • Orion
    • Hercules
    • Jet
    • Gaea
    • Cheyenne
  • WCOSS2
    • Dogwood/Cactus
    • Acorn
  • CI
    • Completed
  • opnReqTest
    • N/A
    • Log attached to comment

@kbooker79 kbooker79 added gaea-RT Incomplete This PR does not have all required information. Please see PR Author checklist. labels Nov 29, 2023
@kbooker79 kbooker79 added jet-BL Run Baseline and RT on Jet hera-RT Run Hera regression testing labels Nov 30, 2023
@epic-cicd-jenkins epic-cicd-jenkins removed the hera-RT Run Hera regression testing label Nov 30, 2023
@kbooker79 kbooker79 added jet-BL Run Baseline and RT on Jet hercules-RT Run Hera regression testing and removed jet-BL Run Baseline and RT on Jet labels Nov 30, 2023
Copy link

@kbooker79 please bring these up to date with respective authoritative repositories

  • ufs-weather-model NOT up to date
  • fv3 NOT up to date

1 similar comment
Copy link

@kbooker79 please bring these up to date with respective authoritative repositories

  • ufs-weather-model NOT up to date
  • fv3 NOT up to date

@epic-cicd-jenkins epic-cicd-jenkins removed the hercules-RT Run Hera regression testing label Nov 30, 2023
@kbooker79 kbooker79 added hera-BL Run Hera baseline creation gaea-BL orion-RT and removed jet-BL Run Baseline and RT on Jet labels Nov 30, 2023
@epic-cicd-jenkins epic-cicd-jenkins removed orion-RT hera-BL Run Hera baseline creation gaea-BL labels Nov 30, 2023
@kbooker79 kbooker79 changed the title feature/add-RT-parallelization, adding new Jenkinsfile to allow regre… PLATFORM 989 - Develop a label (manual) triggered pipeline based on CM team's approval of UFS-WM. New and improved, now with parallelization Dec 1, 2023
@epic-cicd-jenkins epic-cicd-jenkins removed the hercules-RT Run Hera regression testing label Mar 4, 2024
@zach1221 zach1221 added the hercules-RT Run Hera regression testing label Mar 4, 2024
 on-behalf-of @ufs-community <ecc.platform@noaa.gov>
@epic-cicd-jenkins epic-cicd-jenkins removed hercules-RT Run Hera regression testing gaea-RT labels Mar 4, 2024
 on-behalf-of @ufs-community <ecc.platform@noaa.gov>
@zach1221 zach1221 added the hercules-RT Run Hera regression testing label Mar 4, 2024
 on-behalf-of @ufs-community <ecc.platform@noaa.gov>
@epic-cicd-jenkins epic-cicd-jenkins removed the hercules-RT Run Hera regression testing label Mar 4, 2024
@zach1221 zach1221 added the hercules-RT Run Hera regression testing label Mar 4, 2024
 on-behalf-of @ufs-community <ecc.platform@noaa.gov>
@epic-cicd-jenkins epic-cicd-jenkins removed the hercules-RT Run Hera regression testing label Mar 4, 2024
@zach1221 zach1221 mentioned this pull request Mar 4, 2024
14 tasks
zach1221 pushed a commit that referenced this pull request Mar 11, 2024
…ll on macOS arm64 (also contains #2017) (#2164)

* UFSWM - "Add conflict for MOVING_NEST option with GNU Fortran, use mcmodel=small on macOS arm64"
   * FV3 - "Bug fix for unallocated array sfcprop%wetness in      GFS_diagnostics.F90"
     * ccpp-physics - 
     * ccpp-framework - "Bug fix required to use chunked arrays and retain backward compatibility with blocked data 
        structures in ccpp_prebuild.py"
   * Creation of UFS-WM jenkinsfile for pipeline integration
   * Jet Rocky8 updates
     * spack-stack module path
     * eflow location and version
@zach1221
Copy link
Collaborator

@kbooker79 WM PR 2164 is now merged. I will close this PR.

@zach1221 zach1221 closed this Mar 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

New AutoRT for UFS-WM
8 participants