Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New loader #160

Merged
merged 19 commits into from
Jun 28, 2024
Merged

New loader #160

merged 19 commits into from
Jun 28, 2024

Conversation

Kirill888
Copy link
Member

@Kirill888 Kirill888 commented Jun 28, 2024

  • new: zarr loader backend based off xarray mem test driver
  • changes dask driver api, move config from read to source
  • bump minimal dependency of odc-geo

Copy link

github-actions bot commented Jun 28, 2024

@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 05:51 Inactive
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 05:55 Inactive
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 06:02 Inactive
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 06:05 Inactive
- Refactor xrmemreader to support multiple
  xarray inputs
- Add zarr support to xrmemreader
  - Construct xarrays from zarr store when needed
    rather than only using in-memory xarray
- some names not longer fit
- include reference to current driver in the
  loader context
Implement Dask driver backend for Zarr driver
based dask version of xr_reproject.
If driver exposes dask_reader default mode to
"concurrency".
- Make sure to call dask_read.open() only once per
RasterSource object.
- use actual src_idx, not index within a tile
- use tokenize(RasterSource) as cache key
Move `cfg=` into `.open` rather `.read`
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 06:38 Inactive
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 06:56 Inactive
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 07:04 Inactive
revert this when odc-geo==0.4.7 is in conda
@github-actions github-actions bot temporarily deployed to pull request June 28, 2024 07:08 Inactive
@Kirill888 Kirill888 marked this pull request as ready for review June 28, 2024 07:08
@Kirill888 Kirill888 merged commit fbbb956 into develop Jun 28, 2024
25 checks passed
@Kirill888 Kirill888 deleted the hs-load branch June 28, 2024 07:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant