Properly close connections or implement connection reuse

[stevej]

The target server runs out of sockets due to TIME_WAIT and throughput drops

2016-11-22T22:13:20Z 379143/0/0 400000  94% 10s   0 [  3  11  20   64 ]   64 +
2016-11-22T22:13:30Z 378953/0/0 400000  94% 10s   0 [  3  11  19   74 ]   74
2016-11-22T22:13:40Z 386098/0/0 400000  96% 10s   0 [  3   9  16   51 ]   51
2016-11-22T22:13:50Z 369743/0/0 400000  92% 10s   0 [  3  11  19   74 ]   74
2016-11-22T22:14:00Z 382528/0/0 400000  95% 10s   0 [  2  10  25   73 ]   73
2016-11-22T22:14:10Z 397131/0/0 400000  99% 10s   0 [  1   7  12   41 ]   41
2016-11-22T22:14:20Z 393779/0/0 400000  98% 10s   0 [  2   7  14   53 ]   53
2016-11-22T22:14:30Z 392641/0/0 400000  98% 10s   0 [  2   8  16   85 ]   85
2016-11-22T22:14:40Z 390480/0/0 400000  97% 10s   0 [  2   8  18 1008 ] 1008
2016-11-22T22:14:50Z 397733/0/0 400000  99% 10s   0 [  2   6  11   35 ]   35
2016-11-22T22:15:00Z 388203/0/0 400000  97% 10s   0 [  2   9  19   54 ]   54
2016-11-22T22:15:10Z 378096/0/0 400000  94% 10s   0 [  3  13  22  127 ]  127
2016-11-22T22:15:20Z 388446/0/0 400000  97% 10s   0 [  2   9  14   73 ]   73
2016-11-22T22:15:30Z 387618/0/0 400000  96% 10s   0 [  3  10  16  102 ]  102
2016-11-22T22:15:40Z 388657/0/0 400000  97% 10s   0 [  3   9  15   39 ]   39
2016-11-22T22:15:50Z 213906/0/0 400000  53% 10s   0 [  4 120 129  227 ]  227
2016-11-22T22:16:00Z 208904/0/0 400000  52% 10s   0 [  4 120 128  208 ]  208
2016-11-22T22:16:10Z 204244/0/0 400000  51% 10s   0 [  4 123 132  203 ]  203
2016-11-22T22:16:20Z 209137/0/0 400000  52% 10s   0 [  4 121 131  191 ]  191
2016-11-22T22:16:30Z 201940/0/0 400000  50% 10s   0 [  5 123 135  401 ]  401
2016-11-22T22:16:40Z 202599/0/0 400000  50% 10s   0 [  4 122 133  403 ]  403
2016-11-22T22:16:50Z 201139/0/0 400000  50% 10s   0 [  5 121 132  192 ]  192
2016-11-22T22:17:00Z 203549/0/0 400000  50% 10s   0 [  5 121 131  385 ]  385
2016-11-22T22:17:10Z 255853/0/0 400000  63% 10s   0 [  4  22 129  427 ]  427
2016-11-22T22:17:20Z 190785/0/0 400000  47% 10s   0 [  5 125 139  538 ]  538