Movie titles not sorted accordingly -- missing locales

[atony]

Hi,

I use OpenELEC-Ultra.x86_64-devel-20120322051948-r10254 and another xbmc
installation on a PC running Ubuntu 11.10.

Some of the movie titles start with accented letters and these are not sorted accordingly
with respect to Czech conventions on OpenElec. Everything is fine on Ubuntu with
LANG = cs_CZ.UTF-8. If I redefine LANG to en_US.UTF-8 on Ubuntu, I get the same
results as in OpenElec.

By running locale -a on OpenElec I get

C
POSIX

Can you support the other locales?

-- Tony

[sraue]

adding every locales makes OpenELEC around 40MB bigger, what we want to avoid if possible. i dont know if we should do this for cosmetic reasons... also we need a setup option to chice the right locale, and i think many of our target users dont know what to setup there and what this means...

[stefansaraev]

I think we can avoid installing locales. what about just setting LANG / LC_CTYPE / LC_ALL via /etc/profile.d/something ? also we can make this configurable via OE settings addon. If you don't remember we have fixed the messy vdr EPG this way (in addon startup) so it should work

[rickx]

I agree this is needed and not cosmetics. Causes issues at any attempt to sync media from (various) sources. And I add a question: do locales have to be compiled or could they be just added through an addon? Meaning generating them on the running system.

[mikebzh44]

Same issue with MyPicsDB addon :

http://forum.xbmc.org/showthread.php?tid=80845&pid=1119795#pid1119795

Addon can scan directories or pictures with accented charaters.

If I set LANG to fr_FR.UTF-8, I get some warning :

locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
LANG=fr_FR.UTF-8
LC_CTYPE="fr_FR.UTF-8"
LC_NUMERIC="fr_FR.UTF-8"
LC_TIME="fr_FR.UTF-8"
LC_COLLATE="fr_FR.UTF-8"
LC_MONETARY="fr_FR.UTF-8"
LC_MESSAGES="fr_FR.UTF-8"
LC_PAPER="fr_FR.UTF-8"
LC_NAME="fr_FR.UTF-8"
LC_ADDRESS="fr_FR.UTF-8"
LC_TELEPHONE="fr_FR.UTF-8"
LC_MEASUREMENT="fr_FR.UTF-8"
LC_IDENTIFICATION="fr_FR.UTF-8"
LC_ALL=

[henkwiedig]

This might be an option.

diff --git a/packages/toolchain/devel/eglibc/install b/packages/toolchain/devel/eglibc/install
index c602eab..2d8ec49 100755
--- a/packages/toolchain/devel/eglibc/install
+++ b/packages/toolchain/devel/eglibc/install
@@ -47,6 +47,13 @@ mkdir -p $INSTALL/usr/bin
   sed -i 's%bash%sh%g' $INSTALL/usr/bin/ldd

   cp $PKG_BUILD/objdir-$1/locale/locale $INSTALL/usr/bin
+  cp $PKG_BUILD/objdir-$1/locale/localedef $INSTALL/usr/bin
+  mkdir -p $INSTALL/usr/share/i18n/locales/
+  cp $PKG_BUILD/localedata/locales/* $INSTALL/usr/share/i18n/locales/
+  mkdir -p $INSTALL/usr/share/i18n/charmaps
+  cp $PKG_BUILD/localedata/charmaps/* $INSTALL/usr/share/i18n/charmaps/
+  cp $PKG_BUILD/localedata/SUPPORTED $INSTALL/usr/share/i18n/
+  ln -s /storage/locale $INSTALL/usr/lib/locale

 # libiconv replacement:
   mkdir -p $INSTALL/usr/lib/gconv

Users can generate the locale they need on the installed system.
localedef -i de_DE -f UTF-8 de_DE

This locale issue as well impacts vdr-xmltv2vdr and epgdata2xml.
Without an appropriate locale it selects ansi codepage but epgdata.com provides utf-8 encoding.
As well there is an isse with "old" vdr recodings done by an utf-8 system.

[spike411]

If this is still an open issue (seems to me it is):

• 40 MB is not that much. Even if you are running OpenELEC from USB flash disk (as I do) - 1 GB disk costs next to nothing.
• If you really need to keep the install size as small as possible, installing desired pre-generated locales through XBMC addons seems like a nice idea.
• I don't think you need a separate (duplicated) configuration option to set locale - there is already one for XBMC in Appearance - International. Re-use that. (I also think that keyboard layout settings would nicely fit there, while network interface settings would be best kept under System - Network).

BTW Czech user here too. :)

[henkwiedig]

In case no one noticed: Pull #1001 needs 18 MB of additional storage.

[spike411]

Thank you for the clarification. I have not attempted to measure the actual space.

[henkwiedig]

I forgot to mention that the 18 MB are uncompressed. IIRC the System image grows about 4-5 MB.

[jlim0930]

I don't see localedef command on my openelec running

OpenELEC - Version: 2.0.0
ION.x86_64-2.0.0

root ~/videos # find / -name localedef
find: /proc/4088: No such file or directory

can we just add UTF-8 ?

[henkwiedig]

The question is UTF-8 in which language ?

Currently you have to build your own image and pull in PR #1001 to get localdef.
It's currently not included in the official builds.

[jlim0930]

en.UTF-8 would work globally i would think

[henkwiedig]

@jlim0930 Well @atony wants to have czech sorting, i would like german sorting you probably engish sorting.
This has to be language specific. There is no way around it. imho
So en.UTF-8 may work for most people mot not for everyone.

[jenkins101]

Hi,

If this is still an issue please reopen this issue providing new logs from latest OpenELEC release.

[rwky]

This is still an issue PR #1001 was never merged. Openelec doesn't recognise non ascii characters which is causing havoc when running ls on files with accents.

[alanwww1]

Still an issue with 4.0. This causes several things working non-expectedly. For example Midnight Commander, Rutorrent. I am testing with Hungarian language stuff.

[stefansaraev]

52d8c5f and e0b1565 shouldbe enough. @rwky @alanwww1