Release 1.11 - #12914
Closed
Halcyon666 wants to merge 773 commits into
Closed
Conversation
…" document for PyFlink (#12367)
… control into azure pipeline
…e correct way This closes #12591
This closes #12500.
…ordinator class to recreate an OperatorCoordinator instance when resetToCheckpoint() is invoked. Let SourceCoordinator leverage RecreateOnResetOperatorCoordinator to ensure a clean checkpoint reset. Signed-off-by: Jiangjie (Becket) Qin <jiangjie.qj@alibaba-inc.com>
…hread. Signed-off-by: Jiangjie (Becket) Qin <jiangjie.qj@alibaba-inc.com>
… and clarify names
…fka Producer NOTE: This fix does not work without also bumping the Kafka version to sth > 2.4 (2.3 might work as well). Because of KAFKA-6635/KAFKA-7763. Calling close() without timeout is equivalent to calling close(Long.MAX_VALUE). This will leave lingering Kafka threads on shutdown, which eventually cause the Task Manager to be killed by the Flink Task watchdog. We also forbid calling close() without a timeout on our internal Producer, which means that we have to change some code that uses try-with-resources, because this calls close() without a timeout. We need to call close with a zero timeout to prevent in-flight transactions from being aborted by the KafkaProducer/sender. This would break how we use transactions in our Kafka Producer. We don't update FlinkKafkaProducerBase, which is used for non-exactly-once Kafka Producers.
This requires changes to how we use reflection for accessing internals of KafkaProducer. Bumping the version doesn't work without the previous commit where we always call close() with a zero timeout. If we don't call close() with a zero timeout the producer/sender will internally abort in-flight transactions, which would break how we use transactions in our Producer. We add a new error exclusion because the new Kafka version logs slightly different things. We need to update the lz4-java dependency in flink-runtime to match transitive dependency of Kafka 2.4.1 This is required for fixing FLINK-17327.
…Event. Signed-off-by: Jiangjie (Becket) Qin <jiangjie.qj@alibaba-inc.com>
…NOTICE file This closes #12622
…ntrypoint This closes #12596.
…sionCli.run() Currently when starting a yarn session cluster using the yarn-session script or the FlinkYarnSessionCli.run() the displayed execution.target is yarn-per-job, which is misleading. We fix it by explicitly setting it to yarn-session. This closes #12635. (cherry picked from commit cc1f1a4)
This contained entries about bat scripts and vendored files from the old web UI. Both are not part of Flink any more.
…fail with select * This closes #12656
…o use managed memory This closes #12855.
…urceFunction, TypeInformation) doesn't use the user defined type information This closes #12877
… allowed with RANK, DENSE_RANK or ROW_NUMBER functions This closes #12868
…asticsearch table sink This closes #12885
…nd's resultTerm is null This closes #11161
…n can fail This closes #12856
…cument id This closes #12894
…rentReadStateAndProcessAndClose
The tests use oracle jdk, which we can no longer download without logging in. This commit disables the affected tests until we find a solution.
Author
|
Collaborator
|
Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community Automated ChecksLast check on commit 71fa2c1 (Thu Jul 16 14:03:59 UTC 2020) Warnings:
Mention the bot in a comment to re-run the automated checks. Review Progress
Please see the Pull Request Review Guide for a full explanation of the review process. DetailsThe Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commandsThe @flinkbot bot supports the following commands:
|
Collaborator
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
111