Skip to content

SuperSorter: Avoid storing extra writable channels.#13915

Closed
gianm wants to merge 1 commit intoapache:masterfrom
gianm:msq-ss-mem-fix
Closed

SuperSorter: Avoid storing extra writable channels.#13915
gianm wants to merge 1 commit intoapache:masterfrom
gianm:msq-ss-mem-fix

Conversation

@gianm
Copy link
Contributor

@gianm gianm commented Mar 10, 2023

PR #13368 replaced a FrameFile cache with a PartitionedOutputChannel cache. Unfortunately, these objects are heavyweight: each has a writable channel and a frame memory allocator with an 8MB arena. This patch replaces it with a Supplier, which is lighter weight, and is all that was needed anyway.

PR apache#13368 replaced a FrameFile cache with a PartitionedOutputChannel cache. Unfortunately,
these objects are heavyweight: each has a writable channel and a frame memory allocator
with an 8MB arena. This patch replaces it with a Supplier<PartitionedReadableFrameChannel>,
which is lighter weight, and is all that was needed anyway.
@gianm gianm added Bug Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 labels Mar 10, 2023
@gianm
Copy link
Contributor Author

gianm commented Mar 10, 2023

#13755 fixes the same bug.

@gianm gianm closed this Mar 10, 2023
@gianm gianm deleted the msq-ss-mem-fix branch March 10, 2023 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 Bug

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant