Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

features: remove consumer offset migration code + test #7507

Merged

Conversation

jcsp
Copy link
Contributor

@jcsp jcsp commented Nov 25, 2022

This is the data migration path for <= 21.11.x clusters.

This change will land in Redpanda 23.1, at which point
upgrades from pre-22.1.x clusters will no longer support
migrating consumer offsets topic.

There is probably other code that can be cleaned up after this that related
to the routing of group operations to either the old or new topic.

Backports Required

  • none - not a bug fix
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v22.3.x
  • v22.2.x
  • v22.1.x

UX Changes

None

Release Notes

Improvements

  • Migration code for upgrading directly from 21.x Redpanda versions is removed.

@jcsp
Copy link
Contributor Author

jcsp commented Nov 25, 2022

Updated this to remove some of the enable/disable hooks on other subsystems that were only used by this migrator. Changed the definition of the consumer_offsets feature to no longer require preparing (this was causing test failures because consumer group code was never coming up)

This is the migration path for <= 21.11.x clusters.

This change will land in Redpanda 23.1, at which point
upgrades from pre-22.1.x clusters will no longer support
migrating consumer offsets topic.
This test could end up trying to use a decommed node's admin API
to query the status of the cluster, and fail on too many 503s.

Fixes redpanda-data#6721
This was only needed for consumer group migration
logic, which has been removed.
This was only needed for consumer offsets migration
code, which has now been removed.
This was the <= Redpanda 21.x precursor to
consumer offsets topic, which we no longer use.
There is no longer a migrator: if we required migration
it would never activate.
@jcsp jcsp force-pushed the remove-consumer-offsets-migration branch from ba58d4e to f9d030b Compare November 25, 2022 20:49
@jcsp jcsp marked this pull request as ready for review November 27, 2022 18:25
@mmaslankaprv
Copy link
Member

lgtm, i will prepare a pr removing the Kafka bits used to handle old data format

@mmaslankaprv mmaslankaprv merged commit f40fd80 into redpanda-data:dev Nov 28, 2022
@mmaslankaprv mmaslankaprv mentioned this pull request Nov 28, 2022
6 tasks
@dotnwat
Copy link
Member

dotnwat commented Nov 28, 2022

🔥

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants