[#1307] feat(rust): make each thread listen the socket to improve throughput in tonic

[zuston]

What changes were proposed in this pull request?

Make each grpc service thread listens the socket to improve request throughput.

Why are the changes needed?

I‘m always digging the way to solve the request throughput when the writing concurrency is 400. And then I found the few people talk about this, which makes me confused until I see this grpc/grpc-rust#1405 (comment) .

From this blog https://medium.com/@fujita.tomonori/scalable-server-design-in-rust-with-tokio-4c81a5f350a3,
I try to do this optimization, and then do some terasort test. I found the peek receive data speed from 1.2G/s -> 2.0G/s, it works ! And the latency becomes low. And the whole processing time reduces from 20min -> 8.5min

Does this PR introduce any user-facing change?

No.

How was this patch tested?

No need

[zuston]

cc @jerqi

[codecov-commenter]

Codecov Report

Merging #1306 (bb6e1ec) into master (c258076) will increase coverage by 1.01%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #1306      +/-   ##
============================================
+ Coverage     53.35%   54.37%   +1.01%     
  Complexity     2690     2690              
============================================
  Files           410      390      -20     
  Lines         23590    21230    -2360     
  Branches       2003     2003              
============================================
- Hits          12587    11543    -1044     
+ Misses        10229     8984    -1245     
+ Partials        774      703      -71     

see 20 files with indirect coverage changes

📣 Codecov offers a browser extension for seamless coverage viewing on GitHub. Try it in Chrome or Firefox today!