Skip to content

[AMORO-3120]Fix: Corrected issue with merging Parquet files without Field ID, which caused misaligned columns.#3122

Closed
wangmingjin163 wants to merge 1 commit intoapache:masterfrom
wangmingjin163:fix-parquet-field-id
Closed

[AMORO-3120]Fix: Corrected issue with merging Parquet files without Field ID, which caused misaligned columns.#3122
wangmingjin163 wants to merge 1 commit intoapache:masterfrom
wangmingjin163:fix-parquet-field-id

Conversation

@wangmingjin163
Copy link

This PR fixes the issue with merging Parquet files without Field ID, which caused misaligned columns.

The issue is : I encountered an issue when working with Parquet files in the Amoro project. The problem arises when Parquet files are written by using Arrow Schema without Field IDs, which later causes issues during file merging operations. Specifically, the columns in the merged files become misaligned, resulting in incorrect data projections.

Fixes #3120

@github-actions github-actions bot added the module:core Core module label Aug 20, 2024
@zhongqishang
Copy link
Contributor

Thanks for your contribution, @wangmingjin163

A little problem with code checkstyle, you can run mvn spotless:apply to fix it.

The same problem with orc and arvo ?

@czy006
Copy link
Contributor

czy006 commented Sep 4, 2024

cc @wangmingjin163

@github-actions
Copy link

github-actions bot commented Oct 5, 2024

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@amoro.apache.org list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Oct 5, 2024
@github-actions
Copy link

This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

@github-actions github-actions bot closed this Oct 12, 2024
@zhongqishang zhongqishang reopened this Oct 16, 2024
@github-actions github-actions bot removed the stale label Oct 17, 2024
@github-actions
Copy link

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@amoro.apache.org list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Nov 16, 2024
@github-actions
Copy link

This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

@github-actions github-actions bot closed this Nov 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Issue with Merging Parquet Files Without Field ID Leading to Misaligned Columns

3 participants