GDAS diag jobs failing due to insufficient wallclock #1215
Assignees
Labels
bug
Something isn't working
Comments
WalterKolczynski-NOAA
added a commit
to WalterKolczynski-NOAA/global-workflow
that referenced
this issue
Jan 6, 2023
Diag jobs were failing due to insufficient wall clock, so the wall clock is increased until a more complete review of the resources can be completed. Refs NOAA-EMC#1215
10 tasks
WalterKolczynski-NOAA
added a commit
to WalterKolczynski-NOAA/global-workflow
that referenced
this issue
Jan 6, 2023
Diag jobs were failing due to insufficient wall clock, so the wall clock is increased until a more complete review of the resources can be completed. Refs NOAA-EMC#1215
|
@WalterKolczynski-NOAA If this is exclusive to Orion, there have been intermittent system problems recently, apparently with the filesystem, that slow everything (such as builds) down |
WalterKolczynski-NOAA
added a commit
that referenced
this issue
Jan 15, 2023
Diag jobs were failing due to insufficient wall clock, so the wall clock is increased until a more complete review of the resources can be completed. Refs #1215
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Expected behavior
GDAS diag jobs (analdiag and ediag) should complete before hitting the wallclock limit.
Current behavior
GDAS diag jobs (analdiag and ediag) are killed after hitting the wallclock limit, even at low resolution.
Machines affected
Orion, possibly others
To Reproduce
Context
Uncovered during refactoring of j-jobs.
Detailed Description
Unsure why this seems to be a problem now even at low resolutions. Maybe only on Orion or in certain situations?
Additional Information
Possible Implementation
Wallclock will be increased in a package of PRs for the j-job refactoring to eliminate the immediate issue. Longer-term, a more thorough evaluation of resources is needed.
The text was updated successfully, but these errors were encountered: