-
-
Notifications
You must be signed in to change notification settings - Fork 4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Randomly, pushing files to Dropbox results in corrupted file or directory names that contain Unicode code-points #3609
Comments
|
Thanks for reporting this. I can replicate your issues with
I replicated it by using your tdir and repeating the following command line until the file names looked corrupted. I managed to capture a corruption event with the response The path looks sensible in the upload, but if you look at what was returned then the name translates to this Which is the same corruption I saw in the lsf call So since Dropbox gave us back the corrupted name I conclude this must be a corruption happening at dropbox. Here is the complete log: try1.log Any thoughts on this @diwakergupta or suggestions as to where to report this? |
|
I stuck a post about this on the dropbox developer forum. |
|
On the forum I had this reply from Greg K
So yes there is a problem at Dropbox that has now been rolled back. However rclone is doing something wrong too. The problem is caused by the dropbox sdk so I'll report a bug there next... |
|
Here is the upstream issue in the Dropbox SDK: dropbox/dropbox-sdk-go-unofficial#54 |
What is the problem you are having with rclone?
See attached zip with a small python program that empties out a directory, then syncs the same files back into that directory. If you run this a handful of times and watch the files on Dropbox with your browser, eventually you will find that some of the file names get corrupted. It takes about 5 to 10 runs for me. I've not done much isolation on the issue, but I suspect it has to do with creating a file/directory that recently existed. I don't see the problem when running this on Google Drive.
The first image shows the correct filenames. The next two images show two different filenames getting garbled.



bang.zip
What is your rclone version (output from
rclone version)$ rclone version
rclone v1.49.4
Which OS you are using and how many bits (eg Windows 7, 64 bit)
$ cat /etc/centos-release
CentOS Linux release 7.7.1908 (Core)
Which cloud storage system are you using? (eg Google Drive)
Dropbox
The command you were trying to run (eg
rclone copy /tmp remote:tmp)rclone sync tdir Dropbox:tdir
A log from the command with the
-vvflag (eg output fromrclone -vv copy /tmp remote:tmp)The log looks the same for both passing and failing cases:
$ ./bangremote Dropbox:
2019/10/09 20:21:57 DEBUG : rclone: Version "v1.49.4" starting with parameters ["rclone" "-vv" "delete" "Dropbox:/tdir"]
2019/10/09 20:21:57 DEBUG : Using config file from "/home/xxx/.config/rclone/rclone.conf"
2019/10/09 20:21:57 DEBUG : Dropbox root 'tdir': Using root namespace "43255175"
2019/10/09 20:21:57 INFO : Waiting for deletions to finish
2019/10/09 20:21:58 INFO : filename_contains_\u011b_.txt: Deleted
2019/10/09 20:21:58 INFO : filename_contains_\u08ba_.txt: Deleted
2019/10/09 20:21:58 INFO : \u0420\u0443\u0441\u0441\u043a\u0438\u0439.txt: Deleted
2019/10/09 20:21:58 DEBUG : 4 go routines active
2019/10/09 20:21:58 DEBUG : rclone: Version "v1.49.4" finishing with parameters ["rclone" "-vv" "delete" "Dropbox:/tdir"]
2019/10/09 20:21:58 DEBUG : rclone: Version "v1.49.4" starting with parameters ["rclone" "-vv" "sync" "tdir" "Dropbox:/tdir"]
2019/10/09 20:21:58 DEBUG : Using config file from "/home/xxx/.config/rclone/rclone.conf"
2019/10/09 20:21:59 DEBUG : Dropbox root 'tdir': Using root namespace "43255175"
2019/10/09 20:22:00 INFO : Dropbox root 'tdir': Waiting for checks to finish
2019/10/09 20:22:00 INFO : Dropbox root 'tdir': Waiting for transfers to finish
2019/10/09 20:22:00 DEBUG : \u0420\u0443\u0441\u0441\u043a\u0438\u0439.txt: DropboxHash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 OK
2019/10/09 20:22:00 INFO : \u0420\u0443\u0441\u0441\u043a\u0438\u0439.txt: Copied (new)
2019/10/09 20:22:01 DEBUG : filename_contains_\u08ba_.txt: DropboxHash = e250580b3f333a028c41243752bbdc4d084d1c76b672ee5abdbcc76fbefa3cc3 OK
2019/10/09 20:22:01 INFO : filename_contains_\u08ba_.txt: Copied (new)
2019/10/09 20:22:01 DEBUG : filename_contains_\u011b_.txt: DropboxHash = e250580b3f333a028c41243752bbdc4d084d1c76b672ee5abdbcc76fbefa3cc3 OK
2019/10/09 20:22:01 INFO : filename_contains_\u011b_.txt: Copied (new)
2019/10/09 20:22:01 INFO : Waiting for deletions to finish
2019/10/09 20:22:01 INFO :
Transferred: 558 / 558 Bytes, 100%, 437 Bytes/s, ETA 0s
Errors: 0
Checks: 0 / 0, -
Transferred: 3 / 3, 100%
Elapsed time: 1.2s
2019/10/09 20:22:01 DEBUG : 10 go routines active
2019/10/09 20:22:01 DEBUG : rclone: Version "v1.49.4" finishing with parameters ["rclone" "-vv" "sync" "tdir" "Dropbox:/tdir"]
The text was updated successfully, but these errors were encountered: