Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add atm-only ensemble free-forecast #822

Closed
WalterKolczynski-NOAA opened this issue Jun 1, 2022 · 5 comments
Closed

Add atm-only ensemble free-forecast #822

WalterKolczynski-NOAA opened this issue Jun 1, 2022 · 5 comments
Assignees
@XianwuXue-NOAA
Labels
feature New feature or request
Milestone
Incorporate GEFS

Comments

@WalterKolczynski-NOAA
Copy link
Contributor

WalterKolczynski-NOAA commented Jun 1, 2022 •
edited
Loading

Description
As we move towards the merger of GEFS into the GFS system, global workflow needs to be updated to incorporate additional capability to run forecast ensembles beyond that used for EnKF.

Requirements
Run forecast job from pre-staged GEFS initial conditions from the operational run. The additional jobs to produce those initial conditions will be added in a separate future issue.

Since post is now run in-line, the forecast job should generate the appropriate master grib2 files, including the ensemble headers, without the need for a separate post job.

Acceptance Criteria (Definition of Done)
Ability to run atm-only forecast job successfully for an ensemble from GEFS initial conditions that produces the correct master grib files.

Dependencies
Reorganize COM (#761)
Update workflow setup scripts (#789)
Add GEFS IC retrieval (#834)
@WalterKolczynski-NOAA WalterKolczynski-NOAA added the feature New feature or request label Jun 1, 2022
@WalterKolczynski-NOAA WalterKolczynski-NOAA added this to the Incorporate GEFS milestone Jun 1, 2022
Closed
3 tasks
@WalterKolczynski-NOAA WalterKolczynski-NOAA changed the title Add ensemble free-forecast Add atm-only ensemble free-forecast Jun 1, 2022
This was referenced Jun 1, 2022
Closed
Open
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jun 10, 2022
@XianwuXue-NOAA
Improve to run fcst (atm only)
1b5827c 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   jobs/rocoto/fcst.sh
	modified:   ush/forecast_det.sh
	modified:   ush/forecast_postdet.sh
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jul 21, 2022
@XianwuXue-NOAA
Improve the script to run fcst for GEFS
9865bf9 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   jobs/JGLOBAL_FORECAST
	modified:   jobs/rocoto/fcst.sh
	modified:   parm/config/config.fcst
	modified:   ush/forecast_postdet.sh
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
@XianwuXue-NOAA XianwuXue-NOAA linked a pull request Jul 22, 2022 that will close this issue
Add atm-only ensemble free-forecast #924
Closed
6 tasks
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Nov 29, 2022
@XianwuXue-NOAA
Merge branch 'develop' into feature/gefs_v13_822_add_atm_fcst
3f03cdd 
 Conflicts:
	ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Dec 11, 2022
@XianwuXue-NOAA
Modify to run atm fcst for GEFS
9f57a1f 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_postdet.sh
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Dec 12, 2022
@XianwuXue-NOAA
Fix bugs for condition statements
c905b74 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Dec 23, 2022
@XianwuXue-NOAA
Introduce FHOUT_ENKF_GFS for gfsefcs jobs
af7dc51 
    and increase alltime of efcs jobs

 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   parm/config/config.base.emc.dyn
	modified:   parm/config/config.resources
	modified:   scripts/exgdas_enkf_fcst.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Dec 30, 2022
@XianwuXue-NOAA
Add FHOUT_ENKF_GFS to calculate epos group
052ad49 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   workflow/rocoto/workflow_tasks.py

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Dec 30, 2022
@XianwuXue-NOAA
Add GEFS functions with new COM to fcst ush scripts
f0aaaf0 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_det.sh
	modified:   ush/forecast_postdet.sh
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 2, 2023
@XianwuXue-NOAA
Remove unused statements for gefs
a56b707 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   parm/config/config.fcst

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 2, 2023
@XianwuXue-NOAA
Add FLTFILEGFS[F00] & POSTGRB2TBL to pass values
61f44aa 
from external packages such as GEFS

 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   ush/forecast_postdet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 4, 2023
@XianwuXue-NOAA
Add braces around variables to fix the lint warning
4ef0d93 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
\	modified:   ush/forecast_det.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 4, 2023
@XianwuXue-NOAA
Remove FV3_GEFS_nml and use FV3_GFS_nml for GEFS
bf053c1 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   scripts/exglobal_forecast.sh
	modified:   ush/forecast_postdet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 4, 2023
@XianwuXue-NOAA
Remove the new COM dirs
4346c8c 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_postdet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 4, 2023
@XianwuXue-NOAA
Correct a typo
e1f8305 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 4, 2023
@XianwuXue-NOAA
Delete the unused statements
ec701f5 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 7, 2023
@XianwuXue-NOAA
Modify to save RESTART files for both gfs and gefs
4299561 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 11, 2023
@XianwuXue-NOAA
Make RERUN receive value from out of the script
fd325ac 
This is mostly for GEFS forecast_d16_35 job

 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   ush/forecast_det.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 12, 2023
@XianwuXue-NOAA
Delete the GEFS functions to reuse GFS functions
33b4d90 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   scripts/exglobal_forecast.sh
	modified:   ush/forecast_det.sh
	modified:   ush/forecast_postdet.sh
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 17, 2023
@XianwuXue-NOAA
Add { } to variables
119e5b7 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   scripts/exgdas_enkf_fcst.sh
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 19, 2023
@XianwuXue-NOAA
Remove unused RSTDIR
5c95d7a 
 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 22, 2023
@XianwuXue-NOAA
Create links for final restart written files only
1be0572 
  when FHMAX_GFS%restart_interval_gfs=0

These changes will avoid to create invalid links for the final
  restart writting files

 On branch feature/gefs_v13_822_add_atm_fcst
 Changes to be committed:
	modified:   ush/forecast_predet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 24, 2023
@XianwuXue-NOAA
Change memdir/INPUT using ICSDIR to use dif ICSDIR
7ee08e2 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   ush/forecast_postdet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 24, 2023
@XianwuXue-NOAA
Remove unused function
b686fe7 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   ush/forecast_postdet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 25, 2023
@XianwuXue-NOAA
Remove the ICSDIR in the forecast_postdef.sh
1ac2957 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   ush/forecast_postdet.sh

Refs: NOAA-EMC#822
XianwuXue-NOAA added a commit to XianwuXue-NOAA/global-workflow that referenced this issue Jan 25, 2023
@XianwuXue-NOAA
Optimize case statements in the script
c6e082c 
 On branch feature/gefs_v13_822_add_atm_fcst
	modified:   scripts/exglobal_forecast.sh

Refs: NOAA-EMC#822
@XianwuXue-NOAA
Copy link
Contributor

@WalterKolczynski-NOAA Since the PR is merged in to develop. So we can close this issues.

@WalterKolczynski-NOAA
Copy link
Contributor Author

@WalterKolczynski-NOAA Since the PR is merged in to develop. So we can close this issues.

Next time, make sure the has a line that says Fixes #822 at the end so the issue is properly attached and closed when merged.

@XianwuXue-NOAA
Copy link
Contributor

I

@WalterKolczynski-NOAA Since the PR is merged in to develop. So we can close this issues.

Next time, make sure the has a line that says Fixes #822 at the end so the issue is properly attached and closed when merged.

In git commit? like the Refs: #822?

@WalterKolczynski-NOAA
Copy link
Contributor Author

I

@WalterKolczynski-NOAA Since the PR is merged in to develop. So we can close this issues.

Next time, make sure the has a line that says Fixes #822 at the end so the issue is properly attached and closed when merged.

In git commit? like the Refs: #822?

In the PR, you need to use Fixes or Closes. I also don't think you can include a colon if you want GitHub to pick up on it automatically.

@XianwuXue-NOAA
Copy link
Contributor

I

@WalterKolczynski-NOAA Since the PR is merged in to develop. So we can close this issues.

Next time, make sure the has a line that says Fixes #822 at the end so the issue is properly attached and closed when merged.

In git commit? like the Refs: #822?

In the PR, you need to use Fixes or Closes. I also don't think you can include a colon if you want GitHub to pick up on it automatically.

Great. Thanks.

@XianwuXue-NOAA XianwuXue-NOAA mentioned this issue Jan 26, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@XianwuXue-NOAA XianwuXue-NOAA

Labels
feature New feature or request
Projects
None yet
Milestone
Incorporate GEFS
Development

Successfully merging a pull request may close this issue.

Add atm-only ensemble free-forecast XianwuXue-NOAA/global-workflow
2 participants
@WalterKolczynski-NOAA @XianwuXue-NOAA