Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v22.3.x] storage: switch to node_hash_map for kvstore #10414

Merged

Conversation

vbotbuildovich
Copy link
Collaborator

Backport of PR #10340
Fixes #10413,

The flat_hash_map has been seen to produce oversized allocations
with even only a few hundred partitions per core.

While our keys are not huge, the `bytes` type has size 32 due to
inlining, the number of partitions per core can be in
the thousands, and each partitions stores more than one kvstore
entry for distinct storage, raft purposes.

Fixes redpanda-data#10304

(cherry picked from commit be1beb8)
@vbotbuildovich vbotbuildovich added this to the v22.3.x-next milestone Apr 27, 2023
@vbotbuildovich vbotbuildovich added the kind/backport PRs targeting a stable branch label Apr 27, 2023
@jcsp
Copy link
Contributor

jcsp commented May 5, 2023

Failure is:
-#10024

@jcsp jcsp marked this pull request as ready for review May 5, 2023 17:10
@jcsp jcsp merged commit 15f7815 into redpanda-data:v22.3.x May 5, 2023
23 of 26 checks passed
@vshtokman vshtokman modified the milestones: v22.3.x-next, v22.3.18 May 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/redpanda kind/backport PRs targeting a stable branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants