Skip to content

[Kernel][Parquet Writer] Fix an issue with writing decimal as binary#3233

Merged
vkorukanti merged 1 commit intodelta-io:masterfrom
vkorukanti:fixDecimalWrite
Jun 7, 2024
Merged

[Kernel][Parquet Writer] Fix an issue with writing decimal as binary#3233
vkorukanti merged 1 commit intodelta-io:masterfrom
vkorukanti:fixDecimalWrite

Conversation

@vkorukanti
Copy link
Collaborator

@vkorukanti vkorukanti commented Jun 7, 2024

Description

The number of bytes needed to calculate the max buffer size needed when writing the decimal type to Parquet is off by one.

Resolved #3152

How was this patch tested?

Added unit tests that read and write decimals with various precision and scales.

@vkorukanti vkorukanti requested a review from allisonport-db June 7, 2024 17:20
@vkorukanti vkorukanti added this to the 3.3.0 milestone Jun 7, 2024
@vkorukanti vkorukanti merged commit 5289a5e into delta-io:master Jun 7, 2024
vkorukanti added a commit to vkorukanti/delta that referenced this pull request Jun 7, 2024
…elta-io#3233)

## Description
The number of bytes needed to calculate the max buffer size needed when
writing the decimal type to Parquet is off by one.

Resolved delta-io#3152

## How was this patch tested?
Added unit tests that read and write decimals with various precision and
scales.
vkorukanti added a commit that referenced this pull request Jun 7, 2024
…l as binary (#3233) (#3235)

## Description
The number of bytes needed to calculate the max buffer size needed when
writing the decimal type to Parquet is off by one.

Resolved #3152

## How was this patch tested?
Added unit tests that read and write decimals with various precision and
scales.
@vkorukanti vkorukanti deleted the fixDecimalWrite branch July 12, 2024 19:50
vkorukanti added a commit to vkorukanti/delta that referenced this pull request Aug 30, 2024
…elta-io#3233)

## Description
The number of bytes needed to calculate the max buffer size needed when
writing the decimal type to Parquet is off by one.

Resolved delta-io#3152

## How was this patch tested?
Added unit tests that read and write decimals with various precision and
scales.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG][Standalone] Issues while reading decimals

2 participants