Skip to content

Conversation

@medb
Copy link
Contributor

@medb medb commented Sep 13, 2020

No description provided.

Change-Id: I951d7649dfa2f1a4dedf660fd9517a2aaa7b43d5
Change-Id: I614d189d9aa3de2e5bf300a38861c97697a89092
@bmaidics
Copy link
Contributor

Hi @medb ,
I already attempted to upgrade Arrow version to 0.11.0, but faced the same test failure as you: https://issues.apache.org/jira/browse/HIVE-23987
Seems like somehow after the upgrade, the number of rows inserted is 26624, instead of the expected 16384. I don't know if we don't use Arrow properly, or there is a bug in Arrow itself from version 0.11.

@medb
Copy link
Contributor Author

medb commented Sep 18, 2020

@bmaidics thanks for heads up! I plan to take a close look into failing tests, but Arrow 0.11.0 has this fix: apache/arrow#2594

It's possible that because of this fix test writes all data now and that's why it fails after upgrade. But I will need to check failing tests to understand what the right result should be.

@medb
Copy link
Contributor Author

medb commented Sep 18, 2020

@bmaidics I have run test queries on Hive 3.1.2 and they produce 16384 records as expected by test, so there must be something wrong with how Hive uses Arrow after upgrade.

@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Feel free to reach out on the dev@hive.apache.org list if the patch is in need of reviews.

@github-actions github-actions bot added the stale label Nov 18, 2020
@github-actions github-actions bot closed this Nov 25, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants