Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix load large data duplicates #148 #154

Merged
merged 1 commit into from
Jan 16, 2024
Merged

Conversation

zwyan0
Copy link
Contributor

@zwyan0 zwyan0 commented Dec 20, 2023

No description provided.

Copy link
Contributor

@mikecaat mikecaat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good to me.
But, why don't you change the commit massage to note the reason before merging? For example,

title

Fix duplication handling for large data set(#148)

message

BTReaderInit() assumed that the case (itup->t_tid).ip_posid = 0 was anomalous when searching for the leftmost leaf page of a b-tree, but this is an old condition and has been removed.

With the commit (postgres/postgres@8224de4) to support the INCLUDE clause in indexes from PostgreSQL v11, new pivot tuples (e.g. b-tree root and intermediate nodes) were added, which could cause ip_posid to be 0.

Because they had forgotten to address this, errors sometimes occurred when running the process on B-trees that held some large data with pivot tuples.

@Omegapol
Copy link

Omegapol commented Jan 12, 2024

Hey Guys, is this PR, a change that addressed this issue by any chance? #148

@Omegapol
Copy link

I reread the mikecaat's comment and I see #148 there, sorry! I missed that before.
Thanks for fixing this issue! :)

@zwyan0 zwyan0 merged commit 90da084 into ossc-db:master Jan 16, 2024
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants