[FLINK-5886] Python API for streaming applications #3826
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…on Windows This closes apache#2888.
…void multiple classloader problem
…ation of migration package classes, override resolveClass(...) instead This closes apache#3050
- Added info about checkpointing changing the default restart strategy in places where it was missing: the config page and the section about the fixed-delay strategy - Replaced no-restart with "no restart" so people don't think we're referring to a config value - Replaced invalid <it> html tag with <code> - Fixed bad link to restart strategies page from state.md
This closes apache#3059.
This test ensures that we set a low-level processing time timer in case we have processing-time timers set.
… Maven dependency
Introduces a null check to deal with state futures which have a null value. This closes apache#3213.
…tOperators This PR addresses the problem by changing the Emitter's behaviour to first output the element before removing it from the StreamElementQueue. That way the close method waits until also the Emitter has outputted the last completed element. Additionally, the stopResources method now frees the checkpoint lock in order to let the emitter thread react to the interrupt signal. This closes apache#3210.
This closes apache#3200. This closes apache#3198.
…ering them This closes apache#3118.
Previously, deleting in HA mode was only tested with a local file system. This verifies that the delete still works on HDFS. This closes apache#3222.
The test was flakey, because the expected behaviour is actually not possible with the current state of queryable state, which allows uncommitted reads.
When calling PendingCheckpoint.dispose, the state contained of a pending checkpoint is discarded by an asynchronous task. Since this task accesses the taskStates field we must not clear it in PendingCheckpoint.dispose. Instead we will clear it once all state objects have been discarded from within the asynchronous task. This closes apache#3221.
We have to change the instance path to not include too many nested directories, otherwise the Keyed backend cannot properly clean up the whole directory hierarchy.
… operation This PR synchronizes asynchronous checkpointing and close operations of a StreamTask. The synchronization prevents that an acknowledged checkpoint gets discarded and that a discarded checkpoint gets acknowledged. It achieves this by introducing an atomic state variable which guards against late close and acknowledge operations. This closes apache#3227.
…ough InheritableThreadLocal This closes apache#3229
…d inherit from StreamingMultipleProgramsTestBase
3 tasks
Contributor
|
Please close this pull request as it is subsumed by #3838. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration.
If your changes take all of the items into account, feel free to open your pull request. For more information and/or questions please refer to the How To Contribute guide.
In addition to going through the list, please provide a meaningful description of your changes.
General
Documentation
Tests & Build
mvn clean verifyhas been executed successfully locally or a Travis build has passed