Feedback on the use of special caracters in files' name (HFS+ <-> ext4)

[Airwan]

Feedback on the use of bsync between a mac with HFS+ filesystem and a NAS with ext4 partition.

When using special caracters as ñ, ó or í, but not á (forinstance), the synchrnization becomes very unstable through ssh. Move change, rmdir and so on, give errors.

On the contrary, between my laptop with Debian and ext4 partition there is no problem.

Thus, I guess there's a problem with caracter encoding between both type of partition (HFS and ext4) and bsync does not manage it.

[dooblem]

Hi Airwan,
Thanks for the feedback.

Can you test transfering your files with rsync -a ?

The first rsync run should transfer the files. The second run should do nothing.

You should test both directions, ie transfer hfs -> ext4 then ext4 -> hfs

Thanks in advance,
Marc

[Airwan]

Salut et pardon pour retard,

alors voici le bilan. Avec rsync -a aucun souci! Ensuite voici un petit
test.

1. Sur le serveur je créer mon un dossier ñaídossier puis je lance le
backup (avec bsync) une 1ère fois:

serveur$ backup
Loading filelists...
Loading original filelist from snap files...
/Users/Amelie/Documents/ has no permission support (fat?). Ignoring
permissions.
Loading .bsync-snap-20140428095754.567233...
Loading dir1 filelist...
Loading dir2 filelist...
Analysing original paths...
Analysing remaining new paths in dir1...
Analysing remaining new paths in dir2...

[ LEFT DIR CONTENT ] RIGHT DIR CONTENT

/Users/Amelie/Documents root@serveur:/nfs/Backups/Amelie/Documents

                                    <--

ñaídossier/ (mkdir)

Todo in /Users/Amelie/Documents: mkdir:1
Todo in root@serveur:/nfs/Backups/Amelie/Documents:
Apply actions? [y/N] y

Applying actions...
Applying actions in dir2...
Applying actions in dir1...
Updating filelists...
Updating snap files: .bsync-snap-20140428095839.186830...
Done!
Cleaning SSH master...

*2. Puis une 2nd fois!! *

MacBook-Pro-de-Amelie:Documents amelie$ backup
Loading filelists...
Loading original filelist from snap files...
/Users/Amelie/Documents/ has no permission support (fat?). Ignoring
permissions.
Loading .bsync-snap-20140428095839.186830...
Loading dir1 filelist...
Loading dir2 filelist...
Analysing original paths...
Analysing remaining new paths in dir1...
Analysing remaining new paths in dir2...

[ LEFT DIR CONTENT ] RIGHT DIR CONTENT

/Users/amelierambaud/Documents root@serveur:/nfs/Backups/Amelie/Documents

                                    <--

ñaídossier/ (mkdir)
ñaídossier <-- (rmdir)

Todo in /Users/Amelie/Documents: mkdir:1 rmdir:1
Todo in root@serveur:/nfs/Backups/Amelie/Documents:
Apply actions? [y/N] y

Applying actions...
Applying actions in dir2...
Applying actions in dir1...
Traceback (most recent call last):
File "/usr/local/bin/bsync", line 963, in
apply_small_actions(ssh1,dir1name, mkdir1,moves1,rm1,rmdirs1)
File "/usr/local/bin/bsync", line 632, in apply_small_actions
mkdir(shproc, dirname+"/"+f.path, f.perms)
File "/usr/local/bin/bsync", line 513, in mkdir
os.mkdir(path)
FileExistsError: [Errno 17] File exists:
'/Users/Amelie/Documents//ñaídossier'
Cleaning SSH master...

Voici l'erreur!!

J'avoue ne pas comprendre... Je vais essayer d'isoler un peu plus l'erreur.
Une idée peut-être? Ou tu veux que je fasse d'autre test?

Cordialement,
Erwan,

On Mon, Apr 21, 2014 at 12:27 PM, Marc MAURICE notifications@github.comwrote:

Hi Airwan,
Thanks for the feedback.

Can you test transfering your files with rsync -a ?

The first rsync run should transfer the files. The second run should do
nothing.

You should test both directions, ie transfer hfs -> ext4 then ext4 -> hfs

Thanks in advance,
Marc

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/6#issuecomment-40943919
.

[dooblem]

Hi Airwan,
Thanks for the output.
I made a new bsync branch with some fixes in filenames with non utf8 characters.

Can you test it ? see #9

[tomachinz]

I just may have discovered this. In my case did you notice one of these music files has a double-slash in the path like //? Music//Amon Tobin I thought that was pretty weird!! I will go now and fix this file up, hopefully iTunes will not re-mangle it! In my case I was about to proceed with a pretty big sync:

Todo in /Volumes/3tb-HFS/4TB-Backup/Music Drive/Music/iTunes/iTunes Media/Music/: mkdir:142 cp:1592
Todo in /Volumes/4TB/4TB/Music Drive/Music/iTunes/iTunes Media/Music/: mkdir:123 cp:855 sync:3441
Apply actions? [y/N] y

Applying actions...
Traceback (most recent call last):
  File "/usr/local/bin/bsync", line 1041, in <module>
    apply_small_actions(ssh2,dir2name, mkdir2,moves2,rm2,rmdirs2)
  File "/usr/local/bin/bsync", line 673, in apply_small_actions
    mkdir(shproc, dirname.encode()+b"/"+f.path, f.perms)
  File "/usr/local/bin/bsync", line 558, in mkdir
    os.mkdir(path)
FileExistsError: [Errno 17] File exists: b'/Volumes/4TB/4TB/Music Drive/Music/iTunes/iTunes Media/Music//Amon Tobin/Verbal Remixes & Collaborations'
(base) ➜  Music