Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust windows so that method=resample and method=rolling align. Also set skipna=False when computing statistics. This is anticipation of the following development workflow: #143

Closed
wants to merge 0 commits into from

Conversation

copybara-service[bot]
Copy link

@copybara-service copybara-service bot commented Apr 25, 2024

Adjust windows so that method=resample and method=rolling align. Also set skipna=False when computing statistics. This is anticipation of the following development workflow:

  • Make '1w' rolling window version of ground truth
    • Compute '1w' rolling window version of 0.25degree ERA5, 1990-2023, starting from 1h spaced ERA
    • Regrid and compute derived variables
    • Compute climatology
  • Make resampled forecasts
    • Forecast to 6-16 week lead times, with 12hr timedelta spacing, and init time spacing that is an odd multiple of 12h.
    • resample forecasts to weekly and delete (ttl) original forecasts to save space
  • Evaluate resampled forecasts vs. rolled ground truth

Using rolling for ground truth is better than resample. If we used resample, then we'd have to be sure our forecast start times and timedeltas were aligned with the window used for ground truth

Clearly we could also roll the forecasts, but that barely increases statistical power and wastes time & space. For final WB evals, that may make sense, but for development we want something faster and more lightweight.

@copybara-service copybara-service bot changed the title Adjust windows so that method=resample and method=rolling align. Also set skipna=False when computing statistics. Adjust windows so that method=resample and method=rolling align. Also set skipna=False when computing statistics. This is anticipation of the following workflow: Apr 26, 2024
@copybara-service copybara-service bot changed the title Adjust windows so that method=resample and method=rolling align. Also set skipna=False when computing statistics. This is anticipation of the following workflow: Adjust windows so that method=resample and method=rolling align. Also set skipna=False when computing statistics. This is anticipation of the following development workflow: Apr 26, 2024
@copybara-service copybara-service bot force-pushed the test_628129174 branch 2 times, most recently from 6bc5fa3 to b45abe3 Compare May 7, 2024 16:02
@copybara-service copybara-service bot closed this May 7, 2024
@copybara-service copybara-service bot deleted the test_628129174 branch May 7, 2024 16:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

0 participants