New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Global order writer: fixing multi writes for var size attributes. #2963
Conversation
When doing multiple writes, the global order writer saves the var offets it is at per attributes. This fixes the case where a user would write less than one tile more than once, the offset would get reset when it should not. It also fixes an index issue where a partially filled last tile from a previous write got completed on a subsequent write. --- TYPE: IMPROVEMENT DESC: Global order writer: fixing multi writes for var size attributes.
This pull request has been linked to Shortcut Story #15672: Writer issue ingesting VCF data on latest dev.. |
} else { | ||
for (uint64_t i = 0; i < cell_num_to_write; ++cell_idx, ++i) { | ||
if (coord_dups.find(cell_idx) == coord_dups.end()) { | ||
if (cell_num_to_write != 0) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The diff after this is statement is incorrect, the code below has not changed until my next comment.
|
||
(*tiles)[tile_idx + 1].final_size(last_var_offset); | ||
(*tiles)[tile_idx + 1].final_size(last_var_offset); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
After this comment the diff is correct.
) When doing multiple writes, the global order writer saves the var offets it is at per attributes. This fixes the case where a user would write less than one tile more than once, the offset would get reset when it should not. It also fixes an index issue where a partially filled last tile from a previous write got completed on a subsequent write. --- TYPE: IMPROVEMENT DESC: Global order writer: fixing multi writes for var size attributes.
) (#2972) When doing multiple writes, the global order writer saves the var offets it is at per attributes. This fixes the case where a user would write less than one tile more than once, the offset would get reset when it should not. It also fixes an index issue where a partially filled last tile from a previous write got completed on a subsequent write. --- TYPE: IMPROVEMENT DESC: Global order writer: fixing multi writes for var size attributes. Co-authored-by: KiterLuc <67824247+KiterLuc@users.noreply.github.com>
) When doing multiple writes, the global order writer saves the var offets it is at per attributes. This fixes the case where a user would write less than one tile more than once, the offset would get reset when it should not. It also fixes an index issue where a partially filled last tile from a previous write got completed on a subsequent write. --- TYPE: IMPROVEMENT DESC: Global order writer: fixing multi writes for var size attributes.
When doing multiple writes, the global order writer saves the var offets
it is at per attributes. This fixes the case where a user would write
less than one tile more than once, the offset would get reset when it
should not. It also fixes an index issue where a partially filled last
tile from a previous write got completed on a subsequent write.
TYPE: IMPROVEMENT
DESC: Global order writer: fixing multi writes for var size attributes.