Use UTF-8 on host filesystem

[chris-y]

Is your feature request related to a problem? Please describe.
When using a filesystem directory as a hard drive AmiBerry writes files always in the Amiga's charset. This causes weird characters on the Linux side when non-ASCII characters are used on the Amiga filesystem. This makes it difficult to manipulate these files under Linux as they usually can't be typed.

Describe the solution you'd like
Amiga filenames should be translated to/from UTF-8 for Linux filesystem access, probably as an option for compatibility.

[midwan]

@chris-y
Do you have any specific examples of this, please?
Amiberry uses UTF-8 internally, like FS-UAE, for the charset.

[chris-y]

Here's the same file, created under Linux with accented characters.

In Linux:

In Amiberry:

[midwan]

Thanks for the example, I'll look into this further.

[midwan]

In fact, the problem here is the opposite:
Linux can save files in UTF-8 without a problem, but AmigaOS does not support UTF-8. The filenames need to be converted to Latin1 when saving, with "invalid" characters being replaced. I'm working on such a solution, partly using logic from FS-UAE's similar approach.