Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

schema_registry: Override soft-delete checks for consume_to_store #17091

Merged

Conversation

BenPope
Copy link
Member

@BenPope BenPope commented Mar 14, 2024

It's possible that a soft-delete can be compacted away in a different segment to the hard delete. After compaction the topic is still correct and the commands should always be applied to the store.

Override the soft-delete check if the command comes from the topic rather than the REST API.

Fixes https://github.com/redpanda-data/core-internal/issues/1089

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.3.x
  • v23.2.x

Release Notes

Bug Fixes

  • Schema Registry: Deleted schemas no longer reappear after certain compaction patterns on the _schemas topic.

@BenPope BenPope added the area/schema-registry Schema Registry service within Redpanda label Mar 14, 2024
@BenPope BenPope self-assigned this Mar 14, 2024
It's possible that a soft-delete can be compacted away in a different
segment to the hard delete. After compaction the topic is still correct
and the commands should always be applied to the store.

Override the soft-delete check if the command comes from the topic
rather than the REST API.

Signed-off-by: Ben Pope <ben@redpanda.com>
@BenPope BenPope force-pushed the schema_registry_compaction_override branch from 9c078d2 to bf1c314 Compare March 14, 2024 12:35
Copy link
Contributor

@michael-redpanda michael-redpanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@vbotbuildovich
Copy link
Collaborator

new failures in https://buildkite.com/redpanda/redpanda/builds/46180#018e3d4d-db51-494a-87f0-9f7e09ed9c24:

"rptest.tests.partition_balancer_test.PartitionBalancerTest.test_fuzz_admin_ops"

@BenPope
Copy link
Member Author

BenPope commented Mar 14, 2024

Failure is unrelated and looks like #9315

@piyushredpanda piyushredpanda merged commit ea1eaea into redpanda-data:dev Mar 14, 2024
13 of 16 checks passed
@vbotbuildovich
Copy link
Collaborator

/backport v23.3.x

@vbotbuildovich
Copy link
Collaborator

/backport v23.2.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/redpanda area/schema-registry Schema Registry service within Redpanda
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants