Extending intake-esm to RDA holdings: add support for ERA5 Reanalysis

[andersy005]

https://rda.ucar.edu/datasets/ds630.0/

Resources/Documentation:

• https://confluence.ecmwf.int/pages/viewpage.action?pageId=85402030#ERA5terminology:analysisandforecast;timeandsteps;instantaneousandaccumulatedandmeanratesandmin/maxparameters-Instantaneous,accumulated,meanrateandmin/maxparameters
• https://confluence.ecmwf.int/display/CKB/ERA5+data+documentation#ERA5datadocumentation-Dataorganisationandaccess
• https://apps.ecmwf.int/codes/grib/param-db

[andersy005]

Addressed by #68

[mickaellalande]

Is ERA5 reanalysis accessible through intake? Is there an example in the documentation of how to access it?

[andersy005]

Is ERA5 reanalysis accessible through intake? Is there an example in the documentation of how to access it?

Unfortunately no. I opened an issue here: NCAR/intake-esm-datastore#88 to keep track of this... Will ping you once there's an update

[wachsylon]

@andersy005

I made one for dkrz era5 data which is on our HPC's disk storage. That means, the data access also only works on Mistral.

dkrz_cdp=intake.open_catalog("https://swift.dkrz.de/v1/dkrz_a44962e3ba914c309a7421573a6949a6/intake-esm/dkrz_data-pool_cloudcatalog.yaml")
esm_dkrz_era=dkrz_cdp.dkrz_era5_disk_grb_fromcloud

should work.

However, it is based on raw grb data and intake-esm does not really support grb. We would need a default engine here for grib. The one i use is cfgrib. You may say that users can provide that but since there is no grib_kwargs, I cannot for example merge grb assets with netcdf assets. Which is why I say there is no grb support in intake-esm.

Best,
Fabi

[andersy005]

@wachsylon, I concur. We should expand the specification to allow intake-esm catalogs to contain grib: https://github.com/intake/intake-esm/blob/main/docs/source/explanation/esm-collection-spec.md#assets-object

[andersy005]

@wachsylon, I opened an issue for this: #452