In the Producer Performance Benchmark, Topic has a partition number of 1024, specifying the parameter [-o 20000], and found that the maximum number of outstanding messages per producer is 48.
02:23:10.036 [pulsar-client-io-2-1] INFO org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: {
"topicName" : "persistent://xxxx/internal/benchmark2",
"producerName" : null,
"sendTimeoutMs" : 0,
"blockIfQueueFull" : true,
"maxPendingMessages" : 48,
"maxPendingMessagesAcrossPartitions" : 50000,
"messageRoutingMode" : "RoundRobinPartition",
"hashingScheme" : "JavaStringHash",
"cryptoFailureAction" : "FAIL",
"batchingMaxPublishDelayMicros" : 1000,
"batchingMaxMessages" : 1000,
"batchingEnabled" : true,
"compressionType" : "NONE",
"initialSequenceId" : null,
"autoUpdatePartitions" : true,
"properties" : { }
}
- Created a Topic with 1024 partitions.
- Test with the following command:
/pulsar-perf produce persistent://xxxx/internal/benchmark2 -m 10000000 -n 10 -i 5 -time 600 -o 20000 -u pulsar://10.0.231.202:6650,10.0.219.35:6650,10.0.250.94:6650> 0428-002-producer.log
Expected
The number of outstanding consumption messages per partition is 20000 or 20000/partition number.
In the Producer Performance Benchmark, Topic has a partition number of 1024, specifying the parameter [-o 20000], and found that the maximum number of outstanding messages per producer is 48.
02:23:10.036 [pulsar-client-io-2-1] INFO org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: { "topicName" : "persistent://xxxx/internal/benchmark2", "producerName" : null, "sendTimeoutMs" : 0, "blockIfQueueFull" : true, "maxPendingMessages" : 48, "maxPendingMessagesAcrossPartitions" : 50000, "messageRoutingMode" : "RoundRobinPartition", "hashingScheme" : "JavaStringHash", "cryptoFailureAction" : "FAIL", "batchingMaxPublishDelayMicros" : 1000, "batchingMaxMessages" : 1000, "batchingEnabled" : true, "compressionType" : "NONE", "initialSequenceId" : null, "autoUpdatePartitions" : true, "properties" : { } }/pulsar-perf produce persistent://xxxx/internal/benchmark2 -m 10000000 -n 10 -i 5 -time 600 -o 20000 -u pulsar://10.0.231.202:6650,10.0.219.35:6650,10.0.250.94:6650> 0428-002-producer.logExpected
The number of outstanding consumption messages per partition is 20000 or 20000/partition number.