Skip to content

Wave2Web Hack

Wave2Web: H2Ox

This github org contains all the repos associated with H2Ox's winning submission to the Wave2Web Hack and the associated draft publication Wave2Web: Near-real-time reservoir volume prediction for water security in India.

The Wave2Web hackathon, organised by the World Resources Institute and sponsored by Microsoft and Blackrock, took place May through September 2021. The objective of the hackathon was to predict, up to 90 days in the future, the water availability at 4 key reservoirs in the Kaveri basin to the West of Bengaluru. After the hackathon, the H2Ox team took the challenge further and is now providing near-real-time predictions for 70 reservoirs accross India.

h2ox scope basin networks and reservoirs

H2Ox Context

The H2Ox team is Lucas Kruitwagen, Chris Arderne, Tommy Lees, and Lisa Thalheimer.

Contents

This github org contains the following repositories:

  • h2ox-data: Repo for containerised services to fetch ERA5 data and ingest it to a zarr archive
  • h2ox-forecast: Repo for containerised services to fetch TIGGE data and ingest it to a zarr archive
  • h2ox-chirps: Repo for containerised services to fetch CHIRPS data and ingest it to a zarr archive
  • h2ox-reducer: Repo for containerised services to geospatially reduce zarr archive data to timeseries and push to a BigQuery table
  • h2ox-ai: Repo for training and containerised serving of ML models for water volume prediction
  • h2ox-w2w: Repo for near-real-time orchestration: fetching data from India-WRIS, fetching inference, and pushing inference to a BigQuery table
  • h2ox-api: Repo for containerised serving data from a cached BigQuery table
  • h2ox-dash: Repo for lightweight frontend dashboard showing basic problem context and near-real-time inference.

Reproduceability

The repos in this organisation contain everything needed to fully reproduce the h2ox api and service. Appropriate accounts will be required to acquire data from the Copernicus Data Store, to deploy containerised cloud services, and set up cloud storage and query tables as appropriate.

The figure below shows the flow of data through all the services.

h2ox system architecture H2Ox System Architecture

To just work with the reduced dataframes used in h2ox-ai, these are available at gs://oxeo-public/wave2web. Further access to the zarr archives and bigquery tables can be provided on request.

Contact

Please get in touch with us via github issues with any questions or feedback! Pull requests are also welcome!

Popular repositories Loading

  1. h2ox-ai h2ox-ai Public

    This repo is for training machine learning models for the wave2web hackathon

    Jupyter Notebook 4

  2. h2ox-data h2ox-data Public

    A repo for building, serving, and reducing time-chunked ERA5 data on GCP.

    Python 2

  3. h2ox-w2w h2ox-w2w Public

    This repo ingests WRIS data, fetches the latest meteorological data and models, and updates the results for the api.

    Jupyter Notebook 1

  4. h2ox-dash h2ox-dash Public

    Frontend dashboard for the H2Ox data

    JavaScript 1

  5. h2ox-api h2ox-api Public

    A basic FastAPI app to serve wave2web inference

    Python 1

  6. h2ox-forecast h2ox-forecast Public

    A repo for building and maintaining forecast archive data on GCP.

    Python

Repositories

Showing 9 of 9 repositories
  • h2ox-api Public

    A basic FastAPI app to serve wave2web inference

    H2Oxford/h2ox-api’s past year of commit activity
    Python 0 MIT 1 0 0 Updated Jul 7, 2023
  • h2ox-reducer Public

    A repo for reducing zarr data using reservoir geometries

    H2Oxford/h2ox-reducer’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Jul 2, 2023
  • h2ox-w2w Public

    This repo ingests WRIS data, fetches the latest meteorological data and models, and updates the results for the api.

    H2Oxford/h2ox-w2w’s past year of commit activity
    Jupyter Notebook 1 MIT 0 0 0 Updated May 21, 2023
  • h2ox-forecast Public

    A repo for building and maintaining forecast archive data on GCP.

    H2Oxford/h2ox-forecast’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Mar 12, 2023
  • h2ox-chirps Public

    A repo for a containerised service that fetches Chirps data and ingests it to a zarr archive.

    H2Oxford/h2ox-chirps’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Mar 12, 2023
  • h2ox-dash Public

    Frontend dashboard for the H2Ox data

    H2Oxford/h2ox-dash’s past year of commit activity
    JavaScript 0 MIT 1 0 0 Updated Jan 28, 2023
  • h2ox-ai Public

    This repo is for training machine learning models for the wave2web hackathon

    H2Oxford/h2ox-ai’s past year of commit activity
    Jupyter Notebook 4 MIT 0 1 1 Updated Dec 24, 2022
  • h2ox-data Public

    A repo for building, serving, and reducing time-chunked ERA5 data on GCP.

    H2Oxford/h2ox-data’s past year of commit activity
    Python 2 MIT 0 2 0 Updated Jun 2, 2022
  • .github Public

    A public README repo

    H2Oxford/.github’s past year of commit activity
    0 0 0 0 Updated Jun 1, 2022

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…