Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

delete_retention_ms migration is not working when included in redpanda.yaml #15603

Closed
mattschumpert opened this issue Dec 14, 2023 · 1 comment · Fixed by #15605
Closed

delete_retention_ms migration is not working when included in redpanda.yaml #15603

mattschumpert opened this issue Dec 14, 2023 · 1 comment · Fixed by #15605
Assignees
Labels
kind/bug Something isn't working
Milestone

Comments

@mattschumpert
Copy link

mattschumpert commented Dec 14, 2023

Version & Environment

Upgrading to 23.3 via apt update_upgrade on Ubuntu 22

  1. We changed delete_retention_ms to log_retention_ms to be in line with Kafka, but we were supposed to also do a smooth migration of the config value on upgrade to transition the cluster smoothy to the new property. It appears we may not have done this as an upgraded cluster rejects the config in redpanda.yaml (or maybe we migrated it in centralized configuration but can't accept the config from a redpanda.yaml with a hard failure.

  2. We're also not supposed to even remove the legacy config (which is supposed to be aliased) until 24.1.

What is the expected behavior here when sunsetting this config. I guess at some point we can stop accepting it from an external YAML, but at least that is not supposed to happen until 24.1. At most, this should be a deprecated config WARNING that allows Redpanda to start.

We should also double check that we're migrating the centralized cluster config properly from delete_retention_ms to log_retention_ms as planned in our metadata,

Report from beta user:

I had to comment out this line in our Redpanda.yaml, probably a leftover old config that’s in the wrong spot.

redpanda:

        delete_retention_ms: 7776000000

Error was “Failure during startup: std::invalid_argument (Unknown property delete_retention_ms)”

@mattschumpert mattschumpert added the kind/bug Something isn't working label Dec 14, 2023
@mattschumpert mattschumpert added this to the v23.3.1-rc4 milestone Dec 14, 2023
@mattschumpert mattschumpert changed the title delete_retention_ms migration is not working delete_retention_ms migration is not working when included in redpanda.yaml Dec 14, 2023
@andijcr
Copy link
Contributor

andijcr commented Dec 14, 2023

i'm pushing some commits to fix this here #15605 , need to work out a test for this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
None yet
3 participants