Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Global writes: fixing OOM on write continuation. #2993

Merged

Conversation

KiterLuc
Copy link
Contributor

convert_tile_min_max_var_sizes_to_offsets is used to convert a buffer of
sizes to offsets. For global writes, the function will be called
multiple times on the same buffer so the function should resume from the
last tile that was processed. This information is already saved
in tile_index_base_ so the fix is trivial.


TYPE: IMPROVEMENT
DESC: Global writes: fixing OOM on write continuation.

convert_tile_min_max_var_sizes_to_offsets is used to convert a buffer of
sizes to offsets. For global writes, the function will be called
multiple times on the same buffer so the function should resume from the
last tile that was processed. This information is already saved
in tile_index_base_ so the fix is trivial.

---
TYPE: IMPROVEMENT
DESC: Global writes: fixing OOM on write continuation.
@shortcut-integration
Copy link

This pull request has been linked to Shortcut Story #15792: Writer OOM ingesting VCF data.

@KiterLuc KiterLuc merged commit 0c2fe2f into dev Mar 19, 2022
@KiterLuc KiterLuc deleted the lr/convert_tile_min_max_var_sizes_to_offsets-fix/ch15792 branch March 19, 2022 16:43
github-actions bot pushed a commit that referenced this pull request Mar 19, 2022
convert_tile_min_max_var_sizes_to_offsets is used to convert a buffer of
sizes to offsets. For global writes, the function will be called
multiple times on the same buffer so the function should resume from the
last tile that was processed. This information is already saved
in tile_index_base_ so the fix is trivial.

---
TYPE: IMPROVEMENT
DESC: Global writes: fixing OOM on write continuation.
github-actions bot pushed a commit that referenced this pull request Mar 19, 2022
convert_tile_min_max_var_sizes_to_offsets is used to convert a buffer of
sizes to offsets. For global writes, the function will be called
multiple times on the same buffer so the function should resume from the
last tile that was processed. This information is already saved
in tile_index_base_ so the fix is trivial.

---
TYPE: IMPROVEMENT
DESC: Global writes: fixing OOM on write continuation.
ihnorton pushed a commit that referenced this pull request Mar 21, 2022
convert_tile_min_max_var_sizes_to_offsets is used to convert a buffer of
sizes to offsets. For global writes, the function will be called
multiple times on the same buffer so the function should resume from the
last tile that was processed. This information is already saved
in tile_index_base_ so the fix is trivial.

---
TYPE: IMPROVEMENT
DESC: Global writes: fixing OOM on write continuation.
ihnorton pushed a commit that referenced this pull request Mar 21, 2022
convert_tile_min_max_var_sizes_to_offsets is used to convert a buffer of
sizes to offsets. For global writes, the function will be called
multiple times on the same buffer so the function should resume from the
last tile that was processed. This information is already saved
in tile_index_base_ so the fix is trivial.

---
TYPE: IMPROVEMENT
DESC: Global writes: fixing OOM on write continuation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants