New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-14366][tests] Annotate MiniCluster tests in flink-tests with AlsoRunWithSchedulerNG #9900
[FLINK-14366][tests] Annotate MiniCluster tests in flink-tests with AlsoRunWithSchedulerNG #9900
Conversation
Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community Automated ChecksLast check on commit 52978d1 (Thu Oct 24 18:02:04 UTC 2019) Warnings:
Mention the bot in a comment to re-run the automated checks. Review Progress
Please see the Pull Request Review Guide for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commandsThe @flinkbot bot supports the following commands:
|
@flinkbot run travis |
@flinkbot run travis |
@flinkbot run travis |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this PR @zhuzhurk. The changes look good to me. I'll run the tests locally to see that they pass with the new scheduler. If they pass and Travis gives green light, then I'll merge this PR.
…o pass with NG scheduler
…tITCase to pass with NG scheduler
5eb806c
to
cfe3e5a
Compare
Some failed tests were left behind. I have fixed or removed the annotation for them. Here's a result of the testing with scheduler NG https://travis-ci.com/zhuzhurk/flink/builds/132499016. The |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The WindowCheckpointingITCase
failed on my machine when running the tests locally. This seems to be reproducible. Maybe we may not activate this tests to run with the new scheduler right now.
You are right. The test failure is unstable but reproducible. The issue looks similar to that of EventTimeWindowCheckpointingITCase, which should be caused by FLINK-14375. I tried run it with local fixes of FLINK-14375 and no failure happens after a hundred of retries. Will remove the annotation from it in this PR. And annotate it in FLINK-14371 along with EventTimeWindowCheckpointingITCase. |
…lsoRunWithSchedulerNG AbstractTestBase in flink-test-utils is also annotated here to enabled tests based on it. 7 failed tests are not included and will be fixed in separate PRs: * ClassLoaderITCase, EventTimeWindowCheckpointingITCase and WindowCheckpointingITCase in FLINK-14371 * KeyedStateCheckpointingITCase in FLINK-14372 * ZooKeeperHighAvailabilityITCase in FLINK-14373 * RegionFailoverITCase in FLINK-14374 * BatchFineGrainedRecoveryITCase in FLINK-14440
cfe3e5a
to
52978d1
Compare
Thanks for the update @zhuzhurk. I'll try to run it again. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Tests are passing now. Merging this PR now.
What is the purpose of the change
This PR is to annotate all MiniCluster tests with AlsoRunWithSchedulerNG in flink-tests, so that we can know breaking changes in time when further improving the new generation scheduler.
All annotated tests should pass with both legacy and ng scheduler.
7 failed tests are not annotated and will be fixed in separate PRs:
Brief change log
Verifying this change
This change is already covered by the annotated tests themselves.
It's also manually verified by running mvn verify -Dscheduler-ng.
Does this pull request potentially affect one of the following parts:
@Public(Evolving)
: (yes / no)Documentation