Release 1.0.3 rc2#8023
Closed
jaxbihani wants to merge 126 commits into
Closed
Conversation
…h restart Temporary work around to restore initial state on failure during recovery as required by a user. Will be superseded by FLINK-3397 with better handling of checkpoint and savepoint restoring. A failure during recovery resulted in restarting a job without its savepoint state. This temporary work around makes sure that if the savepoint coordinator ever restored a savepoint and there was no checkpoint after the savepoint, the savepoint state will be restored again. This closes apache#1720.
This also includes some minor cleanups This closes apache#1689
… when involked without arguments
…odicWatermarksOperator
…rofile. This closes apache#1719
The new flink-gelly-examples module contains all Java and Scala Gelly examples. The module contains compile scope dependencies on flink-java, flink-scala and flink-clients so that the examples can be conveniently run from within the IDE.
This makes AllWindowedStream.fold() take constant space, just like the keyed WindowOperator. Also this adds a new test case in EventTimeAllWindowCheckpointingITCase to verify that the FoldingWindowBuffer works. This also renames the preexisting window buffers to ReducingWindowBuffer and ListWindowBuffer to make the naming scheme consistent.
This implicitly adds KeyedStream.transform() and also explicitly ConnectedStreams.transform(). This also removes the transform exclusions from the API completeness tests.
…ionService This closes apache#1700.
The current flink-gelly-examples artifact id wrongly used an underscore to separate examples from flink-gelly. This commit replaces the underscore with an hyphen. This closes apache#1731.
…Coordinator This closes apache#1732.
This enforces that the user always has to specify keys for both inputs before .window() can be called.
…ng time This brings it more in line with *ProcessingTimeWindows and makes it clear what type of window assigner it is. The old name, i.e. SlidingTimeWindows and TumblingTimeWindows is still available but deprecated.
…s Guava dependency This closes apache#1737
… SingleOutputStreamOperator
…ection This closes apache#1851
…NoBroker() will pass before JUnit timeout This closes apache#1864
…o docs Java 8 update 11 introduced a stricter bytecode verifier that leads to failures in unit tests that use the PowerMock runner. The tests run correctly in Java 8u51 or above.
…to 'public' This closes apache#1829
The NFA and the SharedBuffer treated window borders differently. Therefore, it was possible that events were pruned even though the NFA still contained references to these events. Now CEP windows are left inclusive and right exclusive.
* Edit config.sh * Document the newly defined log directory configuration key This closes apache#1837
Backport of 8330539. `CheckpointStatsTracker` was instantiated in `ExecutionGraph#enableSnapshotCheckpointing`, where the Flink configuration is not available to parse the configuration. Instead of instantiating the `CheckpointStatsTracker` in the `ExecutionGraph` method, we directly pass it to it.
This PR terminates the ExecutionGraphs properly without restarts when the JobManager calls cancelAndClearEverything. It is achieved by allowing the method to be only called with an SuppressRestartsException. The SuppressRestartsException will disable the restart strategy of the respective ExecutionGraph. This is important because the root cause could be a different exception. In order to avoid race conditions, the restart strategy has to be checked twice whether it allwos to restart the job: Once before and once after the job has transitioned to the state RESTARTING. This avoids that ExecutionGraphs can become an orphan. Furhtermore, this PR fixes the problem that the default restart strategy is shared by multiple jobs. The problem is solved by introducing a RestartStrategyFactory which creates for every job its own instance of a RestartStrategy. Fix LeaderChangeJobRecoveryTest case This closes apache#1923.
We create random files on initialization to check whether we can write to the data directory. These files are also removed now.
This reverts commit 014a686.
Collaborator
|
Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community Review Progress
Please see the Pull Request Review Guide for a full explanation of the review process. DetailsThe Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commandsThe @flinkbot bot supports the following commands:
|
Author
|
Accidentally created, my bad, sorry. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What is the purpose of the change
(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on each deployment (during recovery).)
Brief change log
(for example:)
Verifying this change
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)
Does this pull request potentially affect one of the following parts:
@Public(Evolving): (yes / no)Documentation