Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DRAFT] Add indexing subsystem #153

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from
Draft

[DRAFT] Add indexing subsystem #153

wants to merge 9 commits into from

Commits on Jan 14, 2023

  1. NwpIndex: Add NWP data indexer based on Caterva and ironArray

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    8bc5b1a View commit details
    Browse the repository at this point in the history

  2. NwpIndex: Naming things

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    283c6d4 View commit details
    Browse the repository at this point in the history

  3. NwpIndex: Accept time ranges for querying

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    f802229 View commit details
    Browse the repository at this point in the history

  4. NwpIndex: Clean up query implementation

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    9c94475 View commit details
    Browse the repository at this point in the history

  5. NwpIndex: Add convenience accessor property Result.data 

    It will auto-select the shape of the return value, based on the shape
of the query parameters.
    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    9e2cffd View commit details
    Browse the repository at this point in the history

  6. NwpIndex: Persist original Dataset's schema as netCDF and JSON 

    Because the engine breaks out the actual data from the Dataset into an
ironArray, and its metadata will get lost, it is needed to collect the
schema information about coordinates and dimensions and store it
separately from the `.iarr` data.

This will allow to reconstruct the original Dataset as close as
possible when reading the data back.

Currently, two files, `schema.nc`, and `schema.json` will be stored
within the corresponding `.iarr` folder.
    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    6a689cb View commit details
    Browse the repository at this point in the history

  7. NwpIndex: Unlock querying time range by using pandas' DateTimeIndex

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    72614d8 View commit details
    Browse the repository at this point in the history

  8. NwpIndex: Unlock querying location defined by bounding box

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    8c05e40 View commit details
    Browse the repository at this point in the history

  9. NwpIndex: Unlock querying location defined by circular area

    @amotl
    amotl committed Jan 14, 2023
    Configuration menu
    Copy the full SHA
    7cdcac2 View commit details
    Browse the repository at this point in the history