Corrupted files downloaded

[cyberduck]

bc41a8a created the issue

In trying to move a web site from one server to another we discovered that some of the files were trashed once they got there. We tracked it down to downloading under version 4.4.2. I've attached one of the files that was getting trashed - both the original and the trashed version. The end of the downloaded file is messed up with random bytes. It could be something like a file encoding issue, but the files should be utf8 which is what 'default' used.

• The process was downloading from a linux server to a mac. Then uploading to a new linux server. But the file is corrupted on the initial download. Also doing an Edit (which downloads the file to textmate) shows the file as corrupt.

• The file is not actually corrupted on the server. SSH in and cat the file shows it correctly.

• It's not random. The same files will trash the same exact way each time we download them. Even if they are in different folders. So we suspect it has to do with the contents of the file or the order of the characters or the length of the files. But we don't know.

• These are text files. PHP code and java. But also we did see a .zip file got corrupted on download. But not every zip. Not every text file. About 10 in 200 files on my particular web site.

• We tried from two different macs with two different versions of OS - downloading from the same server. One mac is 10.7.5. Don't know the other one version. Both macs with cyberduck 4.4.2 trash those particular files.

• Using either ForkLift or Cyberduck (13582) 4.4.1 the file downloads correctly with the same settings from that same server.

• We also tried from two different linux servers. Using 4.4.2 that file is always corrupt in the same way, coming down from either of my servers. The servers are both CENTOS 6.4 x86_64 standard but are located in different states and have different versions of OS. One has webmin installed and one has cpanel installed.

---

Attachments

• cyberduck_prob.zip (20.1 KiB)

[cyberduck]

@dkocher commented

What protocol do you use to connect to the server?

[cyberduck]

@dkocher commented

Can you please post the transcript from the log drawer (⌘-L) of the Transfers window for such a corrupt download.

[cyberduck]

@dkocher commented

The regression must have been introduced in 474238b. Added test in 8e4a9ba.

[cyberduck]

@dkocher commented

Rewrote more tests for coverage in 3171898.

[cyberduck]

@dkocher commented

Added failing test in 5a1a839.

[cyberduck]

@dkocher commented

Fixed in f50ea1a by removing buffers.

[cyberduck]

@dkocher commented

Additional fix in 3751955 by always reading full chunk size.

[cyberduck]

@dkocher commented

#7656 closed as duplicate.