Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document common workflows of weather-tools #8

Open
5 tasks
alxmrs opened this issue Nov 24, 2021 · 1 comment
Open
5 tasks

Document common workflows of weather-tools #8

alxmrs opened this issue Nov 24, 2021 · 1 comment

Comments

@alxmrs
Copy link
Collaborator

alxmrs commented Nov 24, 2021

After #7 is complete, we should prepare a "cookbook" of common dev-ops workflows that use weather-tools. These should include:

  • A walkthrough of using each tool in context with each other on GCP.
  • How to use weather-dl to download priority data first.
  • How to schedule dataflow jobs in the future (if possible).
  • How to set up Alerts and monitoring Dashboards in GCP.
  • (reach) using a Cloud Montoring dashboard to view results from the Download Manifest.
@alxmrs alxmrs changed the title Document common usages of weather-tools Document common workflows of weather-tools Nov 24, 2021
@mccloskey
Copy link

Can you please also document how to choose the value of the 'dataset' field in the .cfg file? Or even better, autosuggest values based on the requested ECMWF data fields specified elsewhere in the .cfg file.

For example, some fields (eg 'ttr', 'tsr') are documented by ECMWF to be "single-level", where the 'dataset' field would be called reanalysis-era5-single-levels instead of reanalysis-era5-pressure-levels as shown in the currently checked-in example .cfg files.

I'm guessing, but looks like at the moment, one should inspect the ECMWF URL describing the dataset and use the last part of the URL path, eg: https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels

@alxmrs alxmrs modified the milestone: Sprint 1 Apr 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants