Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

k/group_manager: used chunked_vector when cleaning groups #16920

Merged
merged 1 commit into from
Mar 7, 2024

Conversation

mmaslankaprv
Copy link
Member

@mmaslankaprv mmaslankaprv commented Mar 6, 2024

Consumer groups are removed when a topic that they are related with is removed from topics table. Previously the code cleaning up consumer groups was using a plain std::vector to store deltas coming from the cluster::topics_table notification. That lead to large allocation. Replaced the std::vector with chunked vector to make allocation size controlled.

Fixes: #15946

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.3.x
  • v23.2.x

Release Notes

  • none

Consumer groups are removed when a topic that they are related with is
removed from topics table. Previously the code cleaning up consumer
groups was using a plain `std::vector` to store deltas coming from the
`cluster::topics_table` notification. That lead to large allocation.
Replaced the `std::vector` with chunked vector to make allocation size
controlled.

Fixes: redpanda-data#15946

Signed-off-by: Michal Maslanka <michal@redpanda.com>
@vbotbuildovich
Copy link
Collaborator

@mmaslankaprv mmaslankaprv merged commit cd79db2 into redpanda-data:dev Mar 7, 2024
18 checks passed
@mmaslankaprv mmaslankaprv deleted the fix-15946 branch April 3, 2024 14:46
@mmaslankaprv
Copy link
Member Author

/backport v23.3.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Oversized alloc / OOM in large topic deletion
3 participants