Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-38776][MLLIB][TESTS][FOLLOWUP] Disable ANSI_ENABLED more for Out of Range failures #36054

Closed
wants to merge 1 commit into from
Closed

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Apr 3, 2022

What changes were proposed in this pull request?

This is a follow-up of #36051.
After fixing Overflow errors, Out Of Range failures are observed in the rest of test code in the same test case.

Why are the changes needed?

To make GitHub Action ANSI test CI pass.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

At this time, I used the following to simulate GitHub Action ANSI job.

$ SPARK_ANSI_SQL_MODE=true build/sbt "mllib/testOnly *.ALSSuite"
...
[info] All tests passed.
[success] Total time: 80 s (01:20), completed Apr 3, 2022 1:05:50 PM

@dongjoon-hyun
Copy link
Member Author

cc @gengliangwang , @srowen , @yaooqinn

@dongjoon-hyun
Copy link
Member Author

Thank you, @srowen . This is a single test suite only change, and I verified in two ways. Merged to master/3.3.

SPARK_ANSI_SQL_MODE=true build/sbt "mllib/testOnly *.ALSSuite"
SPARK_ANSI_SQL_MODE=false build/sbt "mllib/testOnly *.ALSSuite"

dongjoon-hyun added a commit that referenced this pull request Apr 3, 2022
…Out of Range` failures

This is a follow-up of #36051.
After fixing `Overflow` errors, `Out Of Range` failures are observed in the rest of test code in the same test case.

To make GitHub Action ANSI test CI pass.

No.

At this time, I used the following to simulate GitHub Action ANSI job.
```
$ SPARK_ANSI_SQL_MODE=true build/sbt "mllib/testOnly *.ALSSuite"
...
[info] All tests passed.
[success] Total time: 80 s (01:20), completed Apr 3, 2022 1:05:50 PM
```

Closes #36054 from dongjoon-hyun/SPARK-38776-2.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit fbcab01)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-38776-2 branch April 4, 2022 06:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
2 participants