Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize empty blobs #93

Closed
vladsud opened this issue Sep 20, 2019 · 2 comments
Closed

Optimize empty blobs #93

vladsud opened this issue Sep 20, 2019 · 2 comments
Assignees
@vladsud @wes-carlson

Comments

@vladsud
Copy link
Contributor

vladsud commented Sep 20, 2019

Looking through bug bash files, one had a lot of blobs, and specifically a lot of empty blobs.
There were a bunch of tables inserted (and deleted), and many had empty "tardis" & "header" blobs (for things like "cols", "rows", "matrix", etc.).

It would be great to optimize it, probably at driver level is the right place to do so.
That might also help with dedupping .attributes (specifically for maps), which are around 120 bytes today. Same for directory's attributes, which I saw in big numbers in same document (around 50).
@vladsud vladsud self-assigned this Sep 20, 2019
@vladsud
Copy link
Contributor Author

vladsud commented Oct 25, 2019

Please take a look. I think this should be managed under bigger "let's reuse same blobs in runtime" umbrella, that would address empty blobs, attributes for various DDSs, maybe sequence blobs (body), etc.

@vladsud
Copy link
Contributor Author

vladsud commented Dec 10, 2019

I believe this problem should be addressed by blob dedupping work Jatin has done.

@vladsud vladsud closed this as completed Dec 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vladsud vladsud

@wes-carlson wes-carlson

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vladsud @wes-carlson