[DO NOT MERGE] Weekly CI Tests Tuesday Oct 03, 2023 #1905

emcbot · 2023-10-03T21:30:38Z

[DO NOT MERGE] Weekly High Resolution CI Tests Tuesday Oct 03, 2023

emcbot · 2023-10-03T22:02:58Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Tue Oct  3 21:32:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 21:38:03 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 22:02:48 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:52 UTC 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:55 UTC 2023 for experiment C384_S2SWA_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:57 UTC 2023 for experiment C384_atm3DVar_725c0b16

emcbot · 2023-10-03T22:05:28Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Tue Oct  3 16:32:17 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 16:34:13 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 17:05:11 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 17:05:19 CDT 2023 for experiment C384_atm3DVar_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 17:05:23 CDT 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 17:05:26 CDT 2023 for experiment C384_S2SWA_725c0b16

emcbot · 2023-10-03T23:26:21Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Tue Oct  3 16:32:17 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 16:34:13 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 17:05:11 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 17:05:19 CDT 2023 for experiment C384_atm3DVar_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 17:05:23 CDT 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 17:05:26 CDT 2023 for experiment C384_S2SWA_725c0b16
Experiment C384C192_hybatmda_725c0b16 Terminated: *FAILED*
Experiment C384C192_hybatmda_725c0b16 Terminated with 1 tasks failed at Tue Oct  3 18:26:16 CDT 2023
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/PR/1905/RUNTESTS/COMROT/C384C192_hybatmda_725c0b16/logs/2023040200/enkfgdaseupd.log

Sitll bot sure why enkf.x exited with error OOM code 137

+ exgdas_enkf_update.sh[392]: /bin/cp -p /work2/noaa/stmp/GFS_CI_ROOT/PR/1905/global-workflow/exec/enkf.x /work/noaa/stmp/mterry/RUNDIRS/C384C192_hybatmda_725c0b16/eupd.169667
++ exgdas_enkf_update.sh[393]: basename /work2/noaa/stmp/GFS_CI_ROOT/PR/1905/global-workflow/exec/enkf.x
+ exgdas_enkf_update.sh[393]: srun -l --export=ALL -n 270 /work/noaa/stmp/mterry/RUNDIRS/C384C192_hybatmda_725c0b16/eupd.169667/enkf.x
+ exgdas_enkf_update.sh[1]: postamble exgdas_enkf_update.sh 1696374954 137
+ preamble.sh[68]: set +x
End exgdas_enkf_update.sh at 23:21:16 with error code 137 (time elapsed: 00:05:22)
+ JGDAS_ENKF_UPDATE[1]: postamble JGDAS_ENKF_UPDATE 1696374947 137
+ preamble.sh[68]: set +x
End JGDAS_ENKF_UPDATE at 23:21:16 with error code 137 (time elapsed: 00:05:29)
+ eupd.sh[1]: postamble eupd.sh 1696374937 137
+ preamble.sh[68]: set +x
End eupd.sh at 23:21:16 with error code 137 (time elapsed: 00:05:39)

(gfs_workflow) mterry (Orion-login-2) C384C192_hybatmda_725c0b16 $ hostname
Orion-login-2.HPC.MsState.Edu
(gfs_workflow) mterry (Orion-login-2) C384C192_hybatmda_725c0b16 $ pwd
/work2/noaa/stmp/GFS_CI_ROOT/PR/1905/RUNTESTS/EXPDIR/C384C192_hybatmda_725c0b16
(gfs_workflow) mterry (Orion-login-2) C384C192_hybatmda_725c0b16 $ rocotocheck -w C384C192_hybatmda_725c0b16.xml -d C384C192_hybatmda_725c0b16.db -c 202304020000 -t enkfgdaseupd | grep nodes
  nodes: 14:ppn=20:tpp=2

rewinding task repeats OOM error at runtime with no other workflow errors found in the in logs ....

mterry (Orion-login-4) ~ $ tail  /work2/noaa/stmp/GFS_CI_ROOT/PR/1905/RUNTESTS/COMROT/C384C192_hybatmda_725c0b16/logs/2023040200/enkfgdaseupd.log
+ exgdas_enkf_update.sh[393]: srun -l --export=ALL -n 270 /work/noaa/stmp/mterry/RUNDIRS/C384C192_hybatmda_725c0b16/eupd.109483/enkf.x
+ exgdas_enkf_update.sh[1]: postamble exgdas_enkf_update.sh 1696451065 137
+ preamble.sh[68]: set +x
End exgdas_enkf_update.sh at 20:30:13 with error code 137 (time elapsed: 00:05:48)
+ JGDAS_ENKF_UPDATE[1]: postamble JGDAS_ENKF_UPDATE 1696451061 137
+ preamble.sh[68]: set +x
End JGDAS_ENKF_UPDATE at 20:30:13 with error code 137 (time elapsed: 00:05:52)
+ eupd.sh[1]: postamble eupd.sh 1696451025 137
+ preamble.sh[68]: set +x
End eupd.sh at 20:30:13 with error code 137 (time elapsed: 00:06:28)

mterry (Orion-login-4) ~ $ head /work/noaa/stmp/mterry/RUNDIRS/C384C192_hybatmda_725c0b16/eupd.109483/stderr
srun: Warning: can't honor --ntasks-per-node set to 20 which doesn't match the requested tasks 270 with the number of requested nodes 14. Ignoring --ntasks-per-node.
264: OZINFO_READ:  jpch_oz=    504
264:   1 sbuv6_n14            lev =    1 use = -1 pob =     0.240 gross =   1.000 error =   1.000 b_oz =  10.000 pg_oz =   0.000
264:   2 sbuv6_n14            lev =    2 use = -1 pob =     0.490 gross =   1.000 error =   1.000 b_oz =  10.000 pg_oz =   0.000
264:   3 sbuv6_n14            lev =    3 use = -1 pob =     0.980 gross =   1.000 error =   1.000 b_oz =  10.000 pg_oz =   0.000
264:   4 sbuv6_n14            lev =    4 use = -1 pob =     1.950 gross =   1.000 error =   1.000 b_oz =  10.000 pg_oz =   0.000
264:   5 sbuv6_n14            lev =    5 use = -1 pob =     3.900 gross =   2.000 error =   1.000 b_oz =  10.000 pg_oz =   0.000
264:   6 sbuv6_n14            lev =    6 use = -1 pob =     7.800 gross =   3.000 error =   1.414 b_oz =  10.000 pg_oz =   0.000
264:   7 sbuv6_n14            lev =    7 use = -1 pob =    15.600 gross =   5.000 error =   1.225 b_oz =  10.000 pg_oz =   0.000
264:   8 sbuv6_n14            lev =    8 use = -1 pob =    31.000 gross =   7.000 error =   1.225 b_oz =  10.000 pg_oz =   0.000
mterry (Orion-login-4) ~ $

Looks like MPMD layout type error.

emcbot · 2023-10-04T00:51:07Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Tue Oct  3 21:32:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 21:38:03 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 22:02:48 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:52 UTC 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:55 UTC 2023 for experiment C384_S2SWA_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:57 UTC 2023 for experiment C384_atm3DVar_725c0b16
Experiment C384C192_hybatmda_725c0b16 completed: *SUCCESS*
Experiment C384C192_hybatmda_725c0b16 Completed at Wed Oct  4 00:51:07 UTC 2023
with 94 successfully completed jobs

emcbot · 2023-10-04T02:12:15Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Tue Oct  3 21:32:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 21:38:03 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 22:02:48 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:52 UTC 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:55 UTC 2023 for experiment C384_S2SWA_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:57 UTC 2023 for experiment C384_atm3DVar_725c0b16
Experiment C384C192_hybatmda_725c0b16 completed: *SUCCESS*
Experiment C384C192_hybatmda_725c0b16 Completed at Wed Oct  4 00:51:07 UTC 2023
with 94 successfully completed jobs
Experiment C384_S2SWA_725c0b16 completed: *SUCCESS*
Experiment C384_S2SWA_725c0b16 Completed at Wed Oct  4 02:12:14 UTC 2023
with 36 successfully completed jobs

emcbot · 2023-10-04T03:36:12Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Tue Oct  3 21:32:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 21:38:03 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 22:02:48 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:52 UTC 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:55 UTC 2023 for experiment C384_S2SWA_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:57 UTC 2023 for experiment C384_atm3DVar_725c0b16
Experiment C384C192_hybatmda_725c0b16 completed: *SUCCESS*
Experiment C384C192_hybatmda_725c0b16 Completed at Wed Oct  4 00:51:07 UTC 2023
with 94 successfully completed jobs
Experiment C384_S2SWA_725c0b16 completed: *SUCCESS*
Experiment C384_S2SWA_725c0b16 Completed at Wed Oct  4 02:12:14 UTC 2023
with 36 successfully completed jobs
Experiment C384_atm3DVar_725c0b16 completed: *SUCCESS*
Experiment C384_atm3DVar_725c0b16 Completed at Wed Oct  4 03:36:12 UTC 2023
with 55 successfully completed jobs

emcbot · 2023-10-04T03:39:08Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Tue Oct  3 21:32:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Tue Oct  3 21:38:03 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Tue Oct  3 22:02:48 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:52 UTC 2023 for experiment C384C192_hybatmda_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:55 UTC 2023 for experiment C384_S2SWA_725c0b16
Created experiment:            *SUCCESS*
Case setup: Completed at Tue Oct  3 22:02:57 UTC 2023 for experiment C384_atm3DVar_725c0b16
Experiment C384C192_hybatmda_725c0b16 completed: *SUCCESS*
Experiment C384C192_hybatmda_725c0b16 Completed at Wed Oct  4 00:51:07 UTC 2023
with 94 successfully completed jobs
Experiment C384_S2SWA_725c0b16 completed: *SUCCESS*
Experiment C384_S2SWA_725c0b16 Completed at Wed Oct  4 02:12:14 UTC 2023
with 36 successfully completed jobs
Experiment C384_atm3DVar_725c0b16 completed: *SUCCESS*
Experiment C384_atm3DVar_725c0b16 Completed at Wed Oct  4 03:36:12 UTC 2023
with 55 successfully completed jobs

WalterKolczynski-NOAA · 2023-10-04T21:32:46Z

@RussTreadon-NOAA Did the GSI update for Intel 2022 increase the memory usage that you know of? This test was succeeding previously on Orion, but we merged #1882 late last week.

TerrenceMcGuinness-NOAA · 2023-10-10T22:52:28Z

Yes doing this made enkfgdaseupd succeed for C384C192_hybatmda on Orion

(gfs_workflow) mterry (Orion-login-2) global-workflow_retest ((HEAD detached at e65162f3)) $ git diff parm/config/gfs/config.resources
diff --git a/parm/config/gfs/config.resources b/parm/config/gfs/config.resources
index a73d702e..beb724f5 100644
--- a/parm/config/gfs/config.resources
+++ b/parm/config/gfs/config.resources
@@ -859,8 +859,8 @@ elif [[ ${step} = "eupd" ]]; then
         export nth_eupd=14
       fi
     elif [[ ${CASE} = "C384" ]]; then
-      export npe_eupd=270
-      export nth_eupd=2
+      export npe_eupd=315
+      export nth_eupd=14
       if [[ "${machine}" = "WCOSS2" ]]; then
         export npe_eupd=315
         export nth_eupd=14

Testing enkf gdas eupd with nth_eupd=8 on Orion for C384

emcbot · 2023-10-11T18:33:04Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct 11 18:04:28 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 18:08:29 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 18:32:52 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 18:32:56 UTC 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 18:32:59 UTC 2023 for experiment C384_S2SWA_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 18:33:01 UTC 2023 for experiment C384_atm3DVar_9abf4b5f

emcbot · 2023-10-11T18:37:16Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct 11 13:05:09 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 13:07:42 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 13:36:56 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:03 CDT 2023 for experiment C384_atm3DVar_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:09 CDT 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:14 CDT 2023 for experiment C384_S2SWA_9abf4b5f

emcbot · 2023-10-11T19:45:26Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct 11 18:04:28 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 18:08:29 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 18:32:52 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 18:32:56 UTC 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 18:32:59 UTC 2023 for experiment C384_S2SWA_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 18:33:01 UTC 2023 for experiment C384_atm3DVar_9abf4b5f
Experiment C384C192_hybatmda_9abf4b5f Terminated: *FAILED*
Experiment C384C192_hybatmda_9abf4b5f Terminated with 1 tasks failed at Wed Oct 11 19:45:23 UTC 2023
Error logs:
/scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/1905/RUNTESTS/COMROT/C384C192_hybatmda_9abf4b5f/logs/2023040200/gdasanal.log

emcbot · 2023-10-11T21:08:15Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct 11 13:05:09 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 13:07:42 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 13:36:56 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:03 CDT 2023 for experiment C384_atm3DVar_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:09 CDT 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:14 CDT 2023 for experiment C384_S2SWA_9abf4b5f
Experiment C384C192_hybatmda_9abf4b5f completed: *SUCCESS*
Experiment C384C192_hybatmda_9abf4b5f Completed at Wed Oct 11 16:08:14 CDT 2023
with 94 successfully completed jobs

emcbot · 2023-10-11T21:10:32Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct 11 13:05:09 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 13:07:42 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 13:36:56 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:03 CDT 2023 for experiment C384_atm3DVar_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:09 CDT 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:14 CDT 2023 for experiment C384_S2SWA_9abf4b5f
Experiment C384C192_hybatmda_9abf4b5f completed: *SUCCESS*
Experiment C384C192_hybatmda_9abf4b5f Completed at Wed Oct 11 16:08:14 CDT 2023
with 94 successfully completed jobs
Experiment C384_atm3DVar_9abf4b5f completed: *SUCCESS*
Experiment C384_atm3DVar_9abf4b5f Completed at Wed Oct 11 16:10:31 CDT 2023
with 55 successfully completed jobs

emcbot · 2023-10-12T05:56:11Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct 11 13:05:09 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 13:07:42 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 13:36:56 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:03 CDT 2023 for experiment C384_atm3DVar_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:09 CDT 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:14 CDT 2023 for experiment C384_S2SWA_9abf4b5f
Experiment C384C192_hybatmda_9abf4b5f completed: *SUCCESS*
Experiment C384C192_hybatmda_9abf4b5f Completed at Wed Oct 11 16:08:14 CDT 2023
with 94 successfully completed jobs
Experiment C384_atm3DVar_9abf4b5f completed: *SUCCESS*
Experiment C384_atm3DVar_9abf4b5f Completed at Wed Oct 11 16:10:31 CDT 2023
with 55 successfully completed jobs
Experiment C384_S2SWA_9abf4b5f completed: *SUCCESS*
Experiment C384_S2SWA_9abf4b5f Completed at Thu Oct 12 00:56:10 CDT 2023
with 36 successfully completed jobs

emcbot · 2023-10-12T05:58:09Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct 11 13:05:09 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct 11 13:07:42 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct 11 13:36:56 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:03 CDT 2023 for experiment C384_atm3DVar_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:09 CDT 2023 for experiment C384C192_hybatmda_9abf4b5f
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct 11 13:37:14 CDT 2023 for experiment C384_S2SWA_9abf4b5f
Experiment C384C192_hybatmda_9abf4b5f completed: *SUCCESS*
Experiment C384C192_hybatmda_9abf4b5f Completed at Wed Oct 11 16:08:14 CDT 2023
with 94 successfully completed jobs
Experiment C384_atm3DVar_9abf4b5f completed: *SUCCESS*
Experiment C384_atm3DVar_9abf4b5f Completed at Wed Oct 11 16:10:31 CDT 2023
with 55 successfully completed jobs
Experiment C384_S2SWA_9abf4b5f completed: *SUCCESS*
Experiment C384_S2SWA_9abf4b5f Completed at Thu Oct 12 00:56:10 CDT 2023
with 36 successfully completed jobs

Moved weekly cases files into pr for high resolution testing

725c0b1

emcbot marked this pull request as draft October 3, 2023 21:30

emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Oct 3, 2023

emcbot added CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Oct 3, 2023

emcbot added CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Oct 4, 2023

TerrenceMcGuinness-NOAA changed the title ~~[DO NOT MERGE] Weekly High Resolution CI Tests Tuesday Oct 03, 2023~~ [DO NOT MERGE] Weekly CI Tests Tuesday Oct 03, 2023 Oct 4, 2023

Update config.resources

9abf4b5

Testing enkf gdas eupd with nth_eupd=8 on Orion for C384

TerrenceMcGuinness-NOAA removed CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed labels Oct 11, 2023

TerrenceMcGuinness-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Oct 11, 2023

emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Oct 11, 2023

emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Oct 11, 2023

emcbot added CI-Orion-Passed **Bot use only** CI testing on Orion for this PR has completed successfully and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Oct 12, 2023

emcbot closed this Oct 12, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[DO NOT MERGE] Weekly CI Tests Tuesday Oct 03, 2023 #1905

[DO NOT MERGE] Weekly CI Tests Tuesday Oct 03, 2023 #1905

emcbot commented Oct 3, 2023

emcbot commented Oct 3, 2023

emcbot commented Oct 3, 2023

emcbot commented Oct 3, 2023 •

edited

Loading

emcbot commented Oct 4, 2023

emcbot commented Oct 4, 2023

emcbot commented Oct 4, 2023

emcbot commented Oct 4, 2023

WalterKolczynski-NOAA commented Oct 4, 2023

TerrenceMcGuinness-NOAA commented Oct 10, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 12, 2023

emcbot commented Oct 12, 2023

[DO NOT MERGE] Weekly CI Tests Tuesday Oct 03, 2023 #1905

[DO NOT MERGE] Weekly CI Tests Tuesday Oct 03, 2023 #1905

Conversation

emcbot commented Oct 3, 2023

emcbot commented Oct 3, 2023

emcbot commented Oct 3, 2023

emcbot commented Oct 3, 2023 • edited Loading

emcbot commented Oct 4, 2023

emcbot commented Oct 4, 2023

emcbot commented Oct 4, 2023

emcbot commented Oct 4, 2023

WalterKolczynski-NOAA commented Oct 4, 2023

TerrenceMcGuinness-NOAA commented Oct 10, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 11, 2023

emcbot commented Oct 12, 2023

emcbot commented Oct 12, 2023

emcbot commented Oct 3, 2023 •

edited

Loading