-
Notifications
You must be signed in to change notification settings - Fork 28k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-12719][HOTFIX] Fix compilation against Scala 2.10 #11798
Conversation
@JoshRosen |
Why not pass it to |
ok to test |
Note that the PR builder won't actually test this against 2.10, so we'll still need to check this out and test it ourselves before merge. |
let me test this |
I tested locally. Unfortunately, it did not fix the problem. |
Test build #53485 has finished for PR 11798 at commit
|
See if this is good. I can modify the description when I get confirmation. |
Test build #53493 has finished for PR 11798 at commit
|
@JoshRosen It seems that tuning @yy2016 I'm merging this to master, will update the commit message while merging. Thanks for the fix! |
@yy2016 Updated commit message:
|
Test build #53492 has finished for PR 11798 at commit
|
PR apache#11696 introduced a complex pattern match that broke Scala 2.10 match unreachability check and caused build failure. This PR fixes this issue by expanding this pattern match into several simpler ones. Note that tuning or turning off `-Dscalac.patmat.analysisBudget` doesn't work for this case. Compilation against Scala 2.10 Author: tedyu <yuzhihong@gmail.com> Closes apache#11798 from yy2016/master.
What changes were proposed in this pull request?
Compilation against Scala 2.10 fails with:
[error] [warn] /home/jenkins/workspace/spark-master-compile-sbt-scala-2.10/sql/hive/src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala:483: Cannot check match for unreachability. [error] (The analysis required more space than allowed. Please try with scalac -Dscalac.patmat.analysisBudget=512 or -Dscalac.patmat.analysisBudget=off.) [error] [warn] private def addSubqueryIfNeeded(plan: LogicalPlan): LogicalPlan = plan match {
This PR increases patmat.analysisBudget
How was this patch tested?
Compilation against Scala 2.10