New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-45541][CORE] Add SSLFactory #43386
Conversation
test failures looked unrelated, retrying now though. |
cc @mridulm @JoshRosen now that tests are green |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Took a quick pass through the change, will go over the PR again in more detail later this week.
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
ed97d4d
to
a1c0f41
Compare
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a couple of nits.
Can you update to master and retrigger the tests please ? Let us see if we can get a clean build (though the failures are not related)
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
f18731e
to
edf1a02
Compare
will re-request review once CI comes back |
common/network-common/src/main/java/org/apache/spark/network/ssl/SSLFactory.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, will wait for CI to succeed.
thanks! some jobs failed, rerunning them so hopefully there is a green CI in the morning |
The test failure is unrelated to this PR. Thanks for fixing this @hasnain-db ! |
What changes were proposed in this pull request?
As titled - add a factory which supports creating SSL engines, and a corresponding builder for it. This will be used in a follow up PR by the
TransportContext
and related files to add SSL support.Why are the changes needed?
We need a mechanism to initialize the appropriate SSL implementation with the configured settings (such as protocol, ciphers, etc) for RPC SSL support.
Does this PR introduce any user-facing change?
No
How was this patch tested?
existing tests. This will be more thoroughly tested in a follow up PR which adds callsites to it. It has been integration tested as part of #42685
Was this patch authored or co-authored using generative AI tooling?
No