[TUBEMQ-433] add tubemq perf-consumer/producer scripts

[yuanboliu]

No description provided.

[dockerzhang]

+1

[gosonzhang]

We need to unify the parameter labels of the CLI to reduce the learning cost of users. I will give a fields definition later

[codecov-io]

Codecov Report

Merging #330 (f565761) into master (ca9ffbe) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

@@             Coverage Diff             @@
##             master    #330      +/-   ##
===========================================
- Coverage      8.03%   8.02%   -0.02%     
+ Complexity      468     466       -2     
===========================================
  Files           249     249              
  Lines         27115   27115              
  Branches       4440    4440              
===========================================
- Hits           2179    2176       -3     
- Misses        24466   24468       +2     
- Partials        470     471       +1     

Impacted Files	Coverage Δ	Complexity Δ
...java/org/apache/tubemq/server/tools/ToolUtils.java	0.00% <0.00%> (ø)	0.00 <0.00> (ø)
.../apache/tubemq/corebase/policies/FlowCtrlItem.java	38.88% <0.00%> (-1.12%)	8.00% <0.00%> (-1.00%)
.../tubemq/corebase/policies/FlowCtrlRuleHandler.java	43.98% <0.00%> (-0.59%)	34.00% <0.00%> (-1.00%)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ca9ffbe...f565761. Read the comment docs.

[gosonzhang]

Hi @yuanboliu

For CLI parameter names, unless it is our own attribute definition, do we try to align it with Kafka as much as possible?
For example, the size of the message, the number of messages, etc. As a user of MQ, I believe everyone has used Kafka, so if we can reduce the learning cost as much as possible, our product will be very user-friendly

like this:

[yuanboliu]

ok, I'll update this pr today

[yuanboliu]

@gosonzhang
sh tubemq-producer-perf-test.sh
sh tubemq-consumer-perf-test.sh

[2020-12-02 15:15:07,974] INFO [Producer] Producer status from ready to running! (org.apache.tubemq.client.producer.ProducerManager)
[2020-12-02 15:15:07,983] INFO [Publish begin 2] publish topicSet [teg_inner_drtest1], address = org.apache.tubemq.client.producer.ProducerManager@583562e5 (org.apache.tubemq.client.producer.ProducerManager)
[2020-12-02 15:15:07,991] INFO [Publish begin 2] already get meta info, topicSet: [teg_inner_drtest1], waste time 7 Ms (org.apache.tubemq.client.producer.ProducerManager)
[2020-12-02 15:15:11,153] INFO Send 1000 message, keyCount is 251 (org.apache.tubemq.example.MAMessageProducerExample)
[2020-12-02 15:15:11,656] INFO Send 2000 message, keyCount is 501 (org.apache.tubemq.example.MAMessageProducerExample)
[2020-12-02 15:15:12,526] INFO Send 3000 message, keyCount is 751 (org.apache.tubemq.example.MAMessageProducerExample)
[2020-12-02 15:15:12,950] INFO Send 4000 message, keyCount is 1001 (org.apache.tubemq.example.MAMessageProducerExample)
[2020-12-02 15:15:14,990] INFO Send 5000 message, keyCount is 1251 (org.apache.tubemq.example.MAMessageProducerExample)
[2020-12-02 15:15:18,017] INFO Send 6000 message, keyCount is 1501 (org.apache.tubemq.example.MAMessageProducerExample)
[2020-12-02 15:15:18,832] INFO Send 7000 message, keyCount is 1751 (org.apache.tubemq.example.MAMessageProducerExample)

[2020-12-02 15:39:07,835] INFO Starting Fetch Worker Pool ! (org.apache.tubemq.client.consumer.MessageFetchManager)
[2020-12-02 15:39:07,835] INFO Prepare to start Fetch Worker Pool, total count:1024 (org.apache.tubemq.client.consumer.MessageFetchManager)
[2020-12-02 15:39:07,901] INFO Fetch Worker Pool started ! (org.apache.tubemq.client.consumer.MessageFetchManager)
[2020-12-02 15:32:31,844] INFO Receive messages:63000 (org.apache.tubemq.example.MsgRecvStats)
[2020-12-02 15:33:41,768] INFO Receive messages:116000 (org.apache.tubemq.example.MsgRecvStats)
[2020-12-02 15:34:25,348] INFO Receive messages:148000 (org.apache.tubemq.example.MsgRecvStats)
[2020-12-02 15:34:52,044] INFO Receive messages:168000 (org.apache.tubemq.example.MsgRecvStats)
[2020-12-02 15:35:00,441] INFO Receive messages:174000 (org.apache.tubemq.example.MsgRecvStats)

[gosonzhang]

@yuanboliu Thanks!

Version 0.7.0 is being released, and I will merge it later.