Improve performance for inflight and payload queue

[cnderrauber]

The payloadQueue.updateSortedKeys costs more than 40% cpu time when send sctp packet at high rate with loss/out of order network. The function is frequently called to order the entire map to generate the sorted slice. This change uses individual queue structs for inflight and payload queue. The inflight queue's chunk tsn is always consecutive so use a queue to hold chunks and it is always ordered, and use bitmask to hold payload tsn queue to calculate cumulative tsn and SACK.

Queue benchmark:

BenchmarkOldPayloadQueue-10    	     332	   3773029 ns/op	 3416218 B/op	   67217     67217 allocs/op
BenchmarkReceivePayloadQueue-10    	    3188	    347581 ns/op	   19488 B/op      2101 allocs/op

Use the sctp send/recv tester in a cpu limited receiver with 50ms rtt network , it also shows lower cpu usage and higher throughput:

target data rate 10MB/s, 1024 message size, 50ms rtt
original: receiver 110% cpu usage, sender 50% cpu usage, result 6.36MB/s
changed: receiver 70% cpu usage, sender 30% cpu usage, result 8.75MB/s

[codecov]

Codecov Report

Attention: Patch coverage is 98.34254% with 3 lines in your changes missing coverage. Please review.

Project coverage is 81.52%. Comparing base (e90e787) to head (86ae184).

Files	Patch %	Lines
queue.go	91.66%	1 Missing and 2 partials ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #337      +/-   ##
==========================================
+ Coverage   81.24%   81.52%   +0.28%     
==========================================
  Files          49       51       +2     
  Lines        3247     3324      +77     
==========================================
+ Hits         2638     2710      +72     
- Misses        468      470       +2     
- Partials      141      144       +3     

Flag	Coverage Δ
go	81.52% <98.34%> (+0.28%)	⬆️
wasm	67.59% <95.02%> (+0.82%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Sean-Der]

Amazing! Those numbers are really exciting @cnderrauber

Would it be possible to drop the dependency?

[edaniels]

fantastic improvement

[cnderrauber]

Amazing! Those numbers are really exciting @cnderrauber

Would it be possible to drop the dependency?

@Sean-Der It can be done by implementing a queue/ring buffer. Do we try to avoid all third-party dependency as possible or just concern this new imported dequeue?

[Sean-Der]

@cnderrauber I try and avoid all third-party dependencies. Currently we only have 3rd party dependencies for testing. Downstream breaking/doing unexpected things has been a problem

[paulwe]

lgtm 🚀

[cnderrauber]

@cnderrauber I try and avoid all third-party dependencies. Currently we only have 3rd party dependencies for testing. Downstream breaking/doing unexpected things has been a problem

Sounds good, will remove it

[boks1971]

lgtm! Awesome stuff @cnderrauber