Unable to transfer files on maximum throughput

[jahanxb]

I am facing an issue in file transfers , I am unable to get the maximum throughput on infinitiband on file transfer. My mellanox device details are CA 'mlx4_0' | CA type: MT4099.
Here is the screenshot of client side

i also wanted to ask if I can increase the buffer limit to increase the file throughput because the maximum I can stretch my buffer limit is 32.

[disprosium8]

hi @jahanxb , thanks for the post. Could you describe your source and destination node environments a little more? It would be good to know what the expected storage I/O performance is expected to be, for example. Is this an HPC cluster you are working on, a local testbed, etc?

Without transferring files (no -f flag), are you able to saturate the network with memory-to-memory tests?

[jahanxb]

hi @disprosium8 , sorry for the late reply, I am using emulab testbeds.
I have been able to connect to nodes without the flag and it seems that I get the speed intended speed.

[jahanxb]

I was able to get the maximum throughput available on the configured Infiniband without -f flag. It might be the case of