Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finish NetCDF loading chunk control code #5399

Closed
3 tasks done
Tracked by #5398
trexfeathers opened this issue Jul 28, 2023 · 2 comments
Closed
3 tasks done
Tracked by #5398

Finish NetCDF loading chunk control code #5399

trexfeathers opened this issue Jul 28, 2023 · 2 comments
Assignees
Labels
Dragon Sub-Task 🦎 https://github.com/orgs/SciTools/projects/19?pane=info

Comments

@trexfeathers
Copy link
Contributor

trexfeathers commented Jul 28, 2023

(Complete the below work on a feature branch)

Documentation has been separated into another issue to make it easier to find time for the work. So chunk control will not be 'releaseable' when this issue is complete.

@trexfeathers trexfeathers added the Dragon Sub-Task 🦎 https://github.com/orgs/SciTools/projects/19?pane=info label Jul 28, 2023
@trexfeathers
Copy link
Contributor Author

Make sure the concepts don't preclude later support for Zarr.

Other formats - PP, FF, GRIB - don't apply to this because the chunking is effectively set by the file structure.

@ESadek-MO
Copy link
Contributor

Decisions on modes:

default: uses iris default behaviour (get from the file, if not, use iris guessing behaviour)
file: takes from the file, else throws an error if file doesn't specify.
guess: uses iris guessing behaviour only. (ignores file specifications, even if it exists)
custom (inc -1): Can manually input custom chunks. -1 might be inheritable from dask?

The use of "none" or "auto" should result in a warning or error to avoid dask confusion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Dragon Sub-Task 🦎 https://github.com/orgs/SciTools/projects/19?pane=info
Projects
No open projects
Status: 🏁 Done
Development

No branches or pull requests

2 participants