Redpanda reports oversized allocation when trying to create topics near the partition limit #16521
Assignees
Labels
kind/bug
Something isn't working
Comments
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 7, 2024
Override the decode path to use chunked_vector for createable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 7, 2024
Override the decode path to use chunked_vector for createable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
7 tasks
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 7, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
7 tasks
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 8, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 8, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 8, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 8, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 8, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 9, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521. (cherry picked from commit 51fda27)
travisdowns
added a commit
to travisdowns/redpanda
that referenced
this issue
Feb 16, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521. (cherry picked from commit 51fda27)
vbotbuildovich
pushed a commit
to vbotbuildovich/redpanda
that referenced
this issue
Feb 16, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521. (cherry picked from commit 51fda27)
ballard26
pushed a commit
to ballard26/redpanda
that referenced
this issue
Feb 21, 2024
Override the decode path to use chunked_vector for creatable_topic as we may have 10,000s of these in a single API request. Arguably, we could use chunked_vector everywhere now in schemata and get rid of this override, but let's do that later. Fixes redpanda-data#16521.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Version & Environment
Manual CDT run using 10 i3en.xlarge nodes on AWS.EC2
Redpanda version: (use
rpk version):Kafka python client
What went wrong?
When creating large topic number (11950) on 9 node redpanda cluster test failed with BadLogLines:
What should have happened instead?
Redpanda able to create topics up to the limit and/or report something like "No more topics creation possible, limit reached"
How to reproduce the issue?
Ducktape cmd line is
(<rp_nodes_cluster> * <vcpu_count> * 1000) / <replica_count>. Example for i3en.xlarge: (941000)/3 = 12000Additional information
Backtrace decoding for one of the logs.
cmd:
python3 ~/seastar-addr2line.py -v -a /usr/bin/llvm-addr2line-14 -e /opt/redpanda/libexec/redpanda -f ~/tests/results/2024-02-07--001/ManyPartitionsTest/test_topic_swarm/1/RedpandaService-0-140592323297680/ip-172-31-3-143/redpanda.logThe text was updated successfully, but these errors were encountered: