Skip to content

Conversation

@aljoscha
Copy link
Contributor

What is the purpose of the change

We migrate all serializer upgrade tests from TypeSerializerSnapshotMigrationTestBase to TypeSerializerUpgradeTestBase. Additionally, we add snapshots for Flink 1.11 for all the serializers. This will give us test coverage from 1.11 onward for serializer compatibility.

This is work by @klion26 and me, I am mostly the reviewer but putting up this PR to have a paper trail.

And thanks a lot to @klion26 for working on this gigantic task with me! 🎊

Brief change log

  • add Flink 1.11 MigrationVersion
  • add snapshots for Flink 1.11, these are from the code added in later commits but we add them to the repo first so that the tests never fail afterwards
  • upgrade test base for Flink 1.11
  • convert individual tests

cc @klion26 Could you do a final review?
cc @tzulitai

aljoscha and others added 30 commits May 27, 2020 11:59
We change MIGRATION_VERSIONS to only test versions > 1.11 because that's
when we're adding the tests. We make an exception for
PojoSerializerUpgradeTest and RowSerializerUpgradeTest, for which we
have earlier snapshots.

This also changes the test base to only generate snapshots for the
CURRENT_VERSION when we generateTestSetupFiles().
Theses snapshots were created on the release-1.11 branch by un-@Ignoring
TypeSerializerUpgradeTestBase.generateTestSetupFiles() and running tests
on each subclass individually.
@flinkbot
Copy link
Collaborator

Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community
to review your pull request. We will use this comment to track the progress of the review.

Automated Checks

Last check on commit b2da3dd (Wed May 27 14:57:47 UTC 2020)

Warnings:

  • No documentation files were touched! Remember to keep the Flink docs up to date!

Mention the bot in a comment to re-run the automated checks.

Review Progress

  • ❓ 1. The [description] looks good.
  • ❓ 2. There is [consensus] that the contribution should go into to Flink.
  • ❓ 3. Needs [attention] from.
  • ❓ 4. The change fits into the overall [architecture].
  • ❓ 5. Overall code [quality] is good.

Please see the Pull Request Review Guide for a full explanation of the review process.

Details
The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands
The @flinkbot bot supports the following commands:

  • @flinkbot approve description to approve one or more aspects (aspects: description, consensus, architecture and quality)
  • @flinkbot approve all to approve all aspects
  • @flinkbot approve-until architecture to approve everything until architecture
  • @flinkbot attention @username1 [@username2 ..] to require somebody's attention
  • @flinkbot disapprove architecture to remove an approval you gave earlier

@flinkbot
Copy link
Collaborator

flinkbot commented May 27, 2020

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run travis re-run the last Travis build
  • @flinkbot run azure re-run the last Azure build

Copy link
Member

@klion26 klion26 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aljoscha thanks for great work!, I just have a minor question about the versions for PojoSerializerUpgradeTest

testVersions.add(MigrationVersion.v1_7);
testVersions.add(MigrationVersion.v1_8);
testVersions.add(MigrationVersion.v1_9);
testVersions.addAll(Arrays.asList(MIGRATION_VERSIONS));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IICU, we do not support v1_10 here because of there did not have the snapshot for 1_10, do we need to add a comment for this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're right, I'm extending the comment here.

@aljoscha
Copy link
Contributor Author

Merged!

@aljoscha aljoscha closed this May 28, 2020
@aljoscha aljoscha deleted the flink-13632-port-ser-upgrade-test branch May 28, 2020 12:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants