Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-28460][SQL][TEST][test-hadoop3.2] Port test from HIVE-11835 #25212

Closed
wants to merge 4 commits into from
Closed

[SPARK-28460][SQL][TEST][test-hadoop3.2] Port test from HIVE-11835 #25212

wants to merge 4 commits into from

Conversation

wangyum
Copy link
Member

@wangyum wangyum commented Jul 20, 2019

What changes were proposed in this pull request?

HIVE-11835 fixed type decimal(1,1) reads 0.0, 0.00, etc from text file as NULL. We fixed this issue after upgrade the build-in Hive to 2.3.5. This PR port the test from HIVE-11835.

Hive test result:
https://github.com/apache/hive/blob/release-2.3.5-rc0/ql/src/test/results/clientpositive/decimal_1_1.q.out#L67-L96

How was this patch tested?

N/A

@SparkQA

This comment has been minimized.

@dongjoon-hyun
Copy link
Member

Retest this please.

@dongjoon-hyun
Copy link
Member

Yes. This is a way to test this. I'm wondering if we can have a simpler test case for this.
(I'm not sure that we need to port all Hive test cases like this.)

cc @gatorsmile

@SparkQA

This comment has been minimized.

@SparkQA

This comment has been minimized.

@SparkQA

This comment has been minimized.

@SparkQA

This comment has been minimized.

@SparkQA

This comment has been minimized.

@wangyum
Copy link
Member Author

wangyum commented Jul 22, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Jul 22, 2019

Test build #107996 has finished for PR 25212 at commit 0589c89.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [SPARK-28460][SQL][TEST] Port test from HIVE-11835 [SPARK-28460][SQL][TEST][test-hadoop3.2] Port test from HIVE-11835 Jul 22, 2019
@wangyum
Copy link
Member Author

wangyum commented Jul 22, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Jul 22, 2019

Test build #108004 has finished for PR 25212 at commit 0589c89.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Retest this please.

@SparkQA
Copy link

SparkQA commented Jul 27, 2019

Test build #108256 has finished for PR 25212 at commit 0589c89.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Although this is a port from Hive, I'll merge this to the master for Hive compatibility because we have several PRs against decimal behavior changes.

Thank you, @wangyum and @HyukjinKwon .

cc @mgaido91 , @gatorsmile , @cloud-fan , @felixcheung

@wangyum wangyum deleted the SPARK-28460 branch July 28, 2019 00:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants