Support the Open Meteo custom data format

[alxmrs]

OM is a custom format created by and for open-meteo.com. It’s a Zarr-like format that I bet would be easy to Kerchunkify.

There seems to be a considerable catalog of weather data curated by Open Meteo on AWS: https://github.com/open-meteo/open-data

Here’s some more info about the format:

• https://github.com/open-meteo/open-data?tab=readme-ov-file#file-format
• Reference implementation: https://github.com/open-meteo/open-meteo/blob/main/Sources/SwiftPFor2D/SwiftPFor2D.swift

Some potential sharp edges:

• “Each individual chunk varies in size”
• “As of now, the Open-Meteo API does not directly support partial reads from S3, but this functionality will be implemented in the future.”

[alxmrs]

xref: open-meteo/open-data#11

[martindurant]

Sounds like a fun little project for someone with spare time or funding. Let's see if open-meteo is interested in your issue. Of course, I know nothing about the format, but "zarr-like" is good.

Each individual chunk varies in size

So maybe it needs ZEP0003, yet another reason why that should be adopted and released. Feel free to add another point in the zep discussion.

[alxmrs]

Thanks Martin! I added to the discussion.