Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ORC-1089: Add test cases verifying writers with selected vector #1009

Merged
merged 1 commit into from Jan 14, 2022

Conversation

guiyanakuang
Copy link
Member

What changes were proposed in this pull request?

This pr aims to add test cases specifically to check that writers support the selected vector feature.

testWriteBaseTypeUseSelectedVector: For covering base types.
testWriteComplexTypeUseSelectedVector: For covering multiple nested types.
testWriteRepeatedUseSelectedVector: For covering repeated values.
testWriteEncryptionUseSelectedVector: For covering field encryption.

Test the idea that the value written to one field is associated with the row number and that the other fields are obtained by some transformation of the value of this field. The feature is guaranteed to be correct by checking the selected row number against the read result.

Why are the changes needed?

Enrich test cases to ensure robustness of feature.

How was this patch tested?

Pass the commit test cases. Currently marked as disabled first until https://github.com/apache/orc/pull/994/files merged

@github-actions github-actions bot added the JAVA label Jan 12, 2022
@dongjoon-hyun dongjoon-hyun changed the title ORC-1004: Add test cases specifically to check that writers support the selected vector feature ORC-1004: Add test cases verifying writers with selected vector Jan 13, 2022
@dongjoon-hyun dongjoon-hyun changed the title ORC-1004: Add test cases verifying writers with selected vector ORC-1089: Add test cases verifying writers with selected vector Jan 13, 2022
@dongjoon-hyun
Copy link
Member

cc @williamhyun , too

Copy link
Member

@wgtmac wgtmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @guiyanakuang

@dongjoon-hyun
Copy link
Member

Thank you, @guiyanakuang and @wgtmac . Merged to main.

@dongjoon-hyun dongjoon-hyun merged commit 907ed6c into apache:main Jan 14, 2022
@dongjoon-hyun dongjoon-hyun added this to the 1.8.0 milestone Jan 14, 2022
cxzl25 pushed a commit to cxzl25/orc that referenced this pull request Jan 11, 2024
…he#1009)

### What changes were proposed in this pull request?

This pr aims to add test cases specifically to check that writers support the selected vector feature.

`testWriteBaseTypeUseSelectedVector`: For covering base types.
`testWriteComplexTypeUseSelectedVector`: For covering multiple nested types.
`testWriteRepeatedUseSelectedVector`: For covering repeated values.
`testWriteEncryptionUseSelectedVector`:  For covering field encryption.

Test the idea that the value written to one field is associated with the row number and that the other fields are obtained by some transformation of the value of this field. The feature is guaranteed to be correct by checking the selected row number against the read result.

### Why are the changes needed?

Enrich test cases to ensure robustness of feature.

### How was this patch tested?

Pass the commit test cases. Currently marked as disabled first until https://github.com/apache/orc/pull/994/files merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants