-
Notifications
You must be signed in to change notification settings - Fork 178
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Sparse global order reader: respect memory budget. #2425
Sparse global order reader: respect memory budget. #2425
Conversation
This pull request has been linked to Clubhouse Story #8652: Refactored readers: Respect memory budget.. |
58035bd
to
6735601
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor comments only.
const std::string Config::SM_MEM_SPARSE_GLOBAL_ORDER_RATIO_QUERY_CONDITION = | ||
"0.25"; | ||
const std::string Config::SM_MEM_SPARSE_GLOBAL_ORDER_RATIO_TILE_RANGES = "0.1"; | ||
const std::string Config::SM_MEM_SPARSE_GLOBAL_ORDER_RATIO_ARRAY_DATA = "0.1"; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
By "array data", do you mean "attribute data"? If so, perhaps name this (and all related configs) to *_ATTR_DATA
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'll keep this one as is, it also includes footers for the fragments.
- Added memory management for query condition and copy attributes ops. - Added configuration parameters for memory budget management. - Cleaning up result tiles not used in result cell slab merging. - Bug fixes to how we load/cleanup result tiles. --- TYPE: IMPROVEMENT DESC: Respect memory budget for sparse global order reader.
6735601
to
528092a
Compare
TYPE: IMPROVEMENT
DESC: Respect memory budget for sparse global order reader.