Slow transfer on localhost

[lucasmaheo]

go-ipfs version

ipfs version 0.4.21

I have deployed a small private swarm of IPFS nodes in Kubernetes on a local network (also tried local host with minikube), and ipfs get is really slow. My CPU should be able to handle this small load, and transfer using scp between "nodes" is lightning fast.

Transfer results

• 162MB file: 46s (average of multiple tries)

• 325MB file: 2m41s (also averaged)

• Initial ipfs add results in 3~4s of hashing.

• ipfs get-ing on the node that added the file results in 1s "download"

Troubleshooting and ideas

I have tried using --routing=none and --routing=dhtclient to no avail.

The gap in transfer time between the two file sizes may indicate it comes from hashing I suppose (the merkle tree must be deeper), but the CPU is not at full capacity.

Any idea what may cause this?

[Stebalien]

This looks like a regression in bitswap. @magik6k has bisected this to 6225024.

[lucasmaheo]

Went back to v0.4.20 for now. This seems to fix the issue, but something may arise on other functionalities I guess.

[magik6k]

A likely fix: ipfs/go-peertaskqueue#5

[Kubuxu]

Fix in ipfs/go-peertaskqueue#7

[hinshun]

Thank you! I was on v0.4.21 with some disappointing speeds which have now improved by ~5x.