Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.
Sign up[SPARK-29613][BUILD][SS] Upgrade to Kafka 2.3.1 #26271
Closed
Conversation
This comment has been minimized.
This comment has been minimized.
SparkQA
commented
Oct 27, 2019
|
Test build #112724 has finished for PR 26271 at commit
|
This comment has been minimized.
This comment has been minimized.
|
The UT failures are irrelevant to this PR. |
This comment has been minimized.
This comment has been minimized.
|
Retest this please. |
1 similar comment
This comment has been minimized.
This comment has been minimized.
|
Retest this please. |
This comment has been minimized.
This comment has been minimized.
SparkQA
commented
Oct 27, 2019
|
Test build #112735 has finished for PR 26271 at commit
|
|
Looks OK pending tests |
This comment has been minimized.
This comment has been minimized.
SparkQA
commented
Oct 27, 2019
|
Test build #112736 has finished for PR 26271 at commit
|
This comment has been minimized.
This comment has been minimized.
|
Thank you, @srowen . |
ulysses-you
pushed a commit
to ulysses-you/spark
that referenced
this pull request
Oct 31, 2019
### What changes were proposed in this pull request? This PR aims to upgrade to Kafka 2.3.1 client library for client fixes like KAFKA-8950, KAFKA-8570, and KAFKA-8635. The following is the full release note. - https://archive.apache.org/dist/kafka/2.3.1/RELEASE_NOTES.html ### Why are the changes needed? - [KAFKA-8950 KafkaConsumer stops fetching](https://issues.apache.org/jira/browse/KAFKA-8950) - [KAFKA-8570 Downconversion could fail when log contains out of order message formats](https://issues.apache.org/jira/browse/KAFKA-8570) - [KAFKA-8635 Unnecessary wait when looking up coordinator before transactional request](https://issues.apache.org/jira/browse/KAFKA-8635) ### Does this PR introduce any user-facing change? No. ### How was this patch tested? Pass the Jenkins with the existing tests. Closes apache#26271 from dongjoon-hyun/SPARK-29613. Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
ulysses-you
pushed a commit
to ulysses-you/spark
that referenced
this pull request
Oct 31, 2019
### What changes were proposed in this pull request? This PR aims to upgrade to Kafka 2.3.1 client library for client fixes like KAFKA-8950, KAFKA-8570, and KAFKA-8635. The following is the full release note. - https://archive.apache.org/dist/kafka/2.3.1/RELEASE_NOTES.html ### Why are the changes needed? - [KAFKA-8950 KafkaConsumer stops fetching](https://issues.apache.org/jira/browse/KAFKA-8950) - [KAFKA-8570 Downconversion could fail when log contains out of order message formats](https://issues.apache.org/jira/browse/KAFKA-8570) - [KAFKA-8635 Unnecessary wait when looking up coordinator before transactional request](https://issues.apache.org/jira/browse/KAFKA-8635) ### Does this PR introduce any user-facing change? No. ### How was this patch tested? Pass the Jenkins with the existing tests. Closes apache#26271 from dongjoon-hyun/SPARK-29613. Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
dongjoon-hyun commentedOct 27, 2019
•
edited
What changes were proposed in this pull request?
This PR aims to upgrade to Kafka 2.3.1 client library for client fixes like KAFKA-8950, KAFKA-8570, and KAFKA-8635. The following is the full release note.
Why are the changes needed?
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Pass the Jenkins with the existing tests.