Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-38776][MLLIB][TESTS] Disable ANSI_ENABLED explicitly in `ALSSu…
…ite` ### What changes were proposed in this pull request? This PR aims to disable `ANSI_ENABLED` explicitly in the following tests of `ALSSuite`. ``` test("ALS validate input dataset") { test("input type validation") { ``` ### Why are the changes needed? After SPARK-38490, this test became flaky in ANSI mode GitHub Action. ![Screen Shot 2022-04-03 at 12 07 29 AM](https://user-images.githubusercontent.com/9700541/161416006-7b76596f-c19a-4212-91d2-8602df569608.png) - https://github.com/apache/spark/runs/5800714463?check_suite_focus=true - https://github.com/apache/spark/runs/5803714260?check_suite_focus=true - https://github.com/apache/spark/runs/5803745768?check_suite_focus=true ``` [info] ALSSuite: ... [info] - ALS validate input dataset *** FAILED *** (2 seconds, 449 milliseconds) [info] Invalid Long: out of range "Job aborted due to stage failure: Task 0 in stage 100.0 failed 1 times, most recent failure: Lost task 0.0 in stage 100.0 (TID 348) (localhost executor driver): org.apache.spark.SparkArithmeticException: Casting 1231000000000 to int causes overflow. To return NULL instead, use 'try_cast'. If necessary set spark.sql.ansi.enabled to false to bypass this error. ``` ### Does this PR introduce _any_ user-facing change? No. This is a test-only bug and fix. ### How was this patch tested? Pass the CIs. Closes #36051 from dongjoon-hyun/SPARK-38776. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
- Loading branch information