Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filter for space-filling-curves #90

Open
mrocklin opened this issue Nov 5, 2016 · 1 comment
Open

Filter for space-filling-curves #90

mrocklin opened this issue Nov 5, 2016 · 1 comment
Labels
enhancement New features or improvements

Comments

@mrocklin
Copy link
Contributor

mrocklin commented Nov 5, 2016

ND-arrays representing spatial data may have highly related data located spatially in an n-dimensional sense. It's possible that pre-ordering the buffer with some sort of space-filling curve would improve compression.

@alimanfoo
Copy link
Member

I think there is overlap with #40 where @shoyer proposed re-ordering each chunk's buffer using the Z-order curve, except here the goal is to improve compression and in #40 the goal is to reduce overhead associated with accessing small data regions.

Looks like there was some discussion of adding support for Z-ordering (Morton ordering) to numpy a while back, but looks like it didn't go anywhere. There is some code by @tgamblin.

cc @benjeffery

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New features or improvements
Projects
None yet
Development

No branches or pull requests

2 participants