Multiple connections for transfers

[cyberduck]

0302cb0 created the issue

There are numerous FTP clients, mostly for windows that already do this. I think a default number of FTP connections, that ANY server admin would not object to is, 2 connections. In fact another popular open source windows ftp program, Filezilla uses 2 connections by default. If you are connecting to a private server (company webserver or shared public hosting) it shouldn't matter the number of connections because there are a limited number of people who have access.

When this feature is implemented it would be advisable to have the ability to change the number of connections in the Properties menu. Also of course make it smart enough not to try to download the same file 2x, if you try to download one large file. It might also be possible to split large files into chunks and use the multiple connections to download the chunks and put them back together after they have been downloaded.

If Cyberduck had this ability it would greatly increase the speed of transfers. You could make one connection list directories and another start transferring files. It would also greatly increase the speed of cyberduck in such cases where there are a lot of small files to transfer. I think we can agree that a faster ducky would make everyone happy. :)

[cyberduck]

54285a4 commented

The preferable way of setting an option like this would be to have a global setting, and then bookmark specific settings if needed. Also, the ability to change it on the fly in a current connection would be ideal!

A feature like this in cyberduck would make it an absolutely ideal FTP client. As it stands, transferring lots of small files is a pain in the balls!

Thanks

Jan

[cyberduck]

Sh4 commented

I agree, this is a must-have feature for me as my dedicated server is throttling international connections to 200k / connection.
Using Filezilla on Windows I am able to max out my 100Mb link by increasing the connection number but Cyberduck is crippled like hell and my weekly 27Gb full DB backups are taking ages to download and archive.

[cyberduck]

Miguel commented

Please! this is a must for any ftp client. The time spent transferring small files would be hugely improved.

Please, at least someone tells us why this isn't being implemented

[cyberduck]

Garrett commented

I agree, this is a must have feature, and would push many user to strongly consider the donations, not having this makes uploads to sites like wordpress very very slow, with many small files it takes forever.

[cyberduck]

Miguel commented

Could any developer answer this? Is there any plan to implement it? Is there any problem keeping you from doing it?

[cyberduck]

@dkocher commented

Replying to [comment:9 Miguel]:

Could any developer answer this? Is there any plan to implement it? Is there any problem keeping you from doing it?

I have not decided against implementing this but haven't found the time needed yet. It is a feature requiring a good amount of work.

[cyberduck]

@dkocher commented

#4498 closed as duplicate.

[cyberduck]

@dkocher commented

#5736 closed as duplicate.

[cyberduck]

@dkocher commented

#5720 closed as duplicate.

[cyberduck]

@dkocher commented

#7061 closed as duplicate.

[cyberduck]

@dkocher commented

Work in 8872244.

[cyberduck]

@dkocher commented

Fix in 1e765b4. Disabled by default. Use the hidden property defaults write ch.sudo.cyberduck queue.session.pool.size 5 and set this to an integer greater than 1 to have multiple connections.

[cyberduck]

@dkocher commented

See Multiple connections per transfer on how to enable.

[cyberduck]

@dkocher commented

#4498 closed as duplicate.

[cyberduck]

@dkocher commented

Added tests in 79b288c.

[cyberduck]

@dkocher commented

Reopen to enable by default in 4.7.

[cyberduck]

@dkocher commented

As of 9deb42f use the setting queue.transfer.type.enabled to enable the option for concurrent connections in the Preferences → Transfers → Transfer Files… and the bookmark settings.

defaults write ~/Library/Preferences/ch.sudo.cyberduck.plist queue.transfer.type.enabled "newconnection browser concurrent" 

[cyberduck]

@dkocher commented

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

[cyberduck]

@dkocher commented

Enabled in 5aeeb69.

[cyberduck]

c79f38e commented

Replying to [comment:26 dkocher]:

This will add the option Open multiple connections. Use the setting Number of concurrent transfers to control the number of parallel connections.

Any way to set this higher than 9? I am not maximizing my bandwidth.