-
Notifications
You must be signed in to change notification settings - Fork 28k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-3756] [Core]check exception is caused by an address-port collision properly #2611
Conversation
Can one of the admins verify this patch? |
@@ -1470,6 +1472,7 @@ private[spark] object Utils extends Logging { | |||
return true | |||
} | |||
isBindCollision(e.getCause) | |||
case e: MultiException => e.getThrowables.map(ex => isBindCollision(ex)).reduceLeft(_ || _) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think you can just write e.getThrowables.exists(isBindCollision)
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, thanks, more cleanly
Jenkins, test this please. LGTM pending tests. |
QA tests have started for PR 2611 at commit
|
QA tests have finished for PR 2611 at commit
|
Test PASSed. |
@@ -23,6 +23,8 @@ import java.nio.ByteBuffer | |||
import java.util.{Properties, Locale, Random, UUID} | |||
import java.util.concurrent.{ThreadFactory, ConcurrentHashMap, Executors, ThreadPoolExecutor} | |||
|
|||
import org.eclipse.jetty.util.MultiException |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
too late (already merged) but this should be grouped with the other imports below :(
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
very sorry for this, should i make a PR to fix this?
…sion properly Jetty server use MultiException to handle exceptions when start server refer https://github.com/eclipse/jetty.project/blob/jetty-8.1.14.v20131031/jetty-server/src/main/java/org/eclipse/jetty/server/Server.java So in ```isBindCollision``` add the logical to cover MultiException Author: scwf <wangfei1@huawei.com> Closes #2611 from scwf/fix-isBindCollision and squashes the following commits: 984cb12 [scwf] optimize the fix 3a6c849 [scwf] fix bug in isBindCollision (cherry picked from commit 2fedb5d) Signed-off-by: Patrick Wendell <pwendell@gmail.com> Conflicts: core/src/main/scala/org/apache/spark/util/Utils.scala
Jetty server use MultiException to handle exceptions when start server
refer https://github.com/eclipse/jetty.project/blob/jetty-8.1.14.v20131031/jetty-server/src/main/java/org/eclipse/jetty/server/Server.java
So in
isBindCollision
add the logical to cover MultiException