Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PARQUET-2215: [Format] Document overflow handling in DELTA_BINARY_PACKED #187

Merged
merged 2 commits into from
Nov 25, 2022

Conversation

pitrou
Copy link
Member

@pitrou pitrou commented Nov 23, 2022

Also word-wrapping for better source readability and editability.

@pitrou
Copy link
Member Author

pitrou commented Nov 23, 2022

cc @rok

Encodings.md Outdated
Comment on lines 222 to 225
Subtractions in steps 1) and 2) may incur signed arithmetic overflow. Overflow
should be allowed and handled as wrapping around in 2's complement notation.
This may require explicit care in some programming languages (for example by
doing all arithmetic in the unsigned domain).
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps we should note that this produces the correct result on decoding?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Isn't that implied?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is, but maybe if it were less subtle it would save readers having to reason through it?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, I elaborated a bit. Does it help?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It does! :)

@pitrou
Copy link
Member Author

pitrou commented Nov 23, 2022

@ksuarez1423 @wjones127 Would you like to take a look at the wording?

@pitrou pitrou merged commit 111dbdc into apache:master Nov 25, 2022
@pitrou pitrou deleted the PARQUET-2215-delta-overflow branch November 25, 2022 08:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants