Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update cleanup job to scrub ensemble data #833

Open
WalterKolczynski-NOAA opened this issue Jun 1, 2022 · 0 comments
Open

Update cleanup job to scrub ensemble data #833

WalterKolczynski-NOAA opened this issue Jun 1, 2022 · 0 comments
Labels
feature New feature or request

Comments

@WalterKolczynski-NOAA
Copy link
Contributor

Description
As forecast ensemble jobs are added to the global workflow, we need to ensure the output is being cleaned up properly once it is no longer needed.

Requirements
The cleanup job (currently part of archive) needs to properly scrub ensemble data once it is has been archived and is no longer needed. Until ensemble verification is added as part of the workflow instead of a stand-alone system, this may involve a smaller set of data than current deterministic, which does verification within the workflow.

This will be an ongoing issue completed incrementally as pieces of the forecast ensemble are added.

Acceptance Criteria (Definition of Done)
A cleanup job that properly removes old ensemble data once it is no longer needed.

Dependencies
Add atm-only ensemble free-forecast (#822)
Add atm ensemble product generation (#823)

@WalterKolczynski-NOAA WalterKolczynski-NOAA added the feature New feature or request label Jun 1, 2022
@WalterKolczynski-NOAA WalterKolczynski-NOAA added this to the Incorporate GEFS milestone Jun 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant