Umlaut or similar ("ä, ö, ü ...") characters cannot be displayed correctly in the console.

[delgermurun]

When I'm labeling, Zingg is unable to show me ä, ö, ü ... kinds of characters correctly in the console. The console shows ? instead of the correct character.

File's encoding is utf-8 and CSV file.

• OS: macOS Monterey. But I am running Zingg from Docker.
• iTerm2 with zsh.
• Zingg version 0.3.1

Thank you in advance!

[sonalgoyal]

@navinrathore - can you please take a look at this? you can replace our febrl test file with some of the above characters and test.

[navinrathore]

I quickly checked by running zingg on a xterm (Ubuntu-20). These chars were display on screen. On your iterm2, Could you try to run cat "data-filename" and let us know if it shows these chars or not?

[sonalgoyal]

@delgermurun - can you please check?

[delgermurun]

@navinrathore @sonalgoyal thanks for the quick responses.

cat <filename> works fine on my iTerm2.

[sonalgoyal]

which version of java are you using @delgermurun ?

[delgermurun]

@sonalgoyal I am running Zingg's Docker image directly (by binding my data directory as a volume)
here is an output of the java -version command.

I have no name!@0bf5a68b729f:/zingg-0.3.1-SNAPSHOT/scripts$ java -version
openjdk version "1.8.0_312"
OpenJDK Runtime Environment (build 1.8.0_312-b07)
OpenJDK 64-Bit Server VM (build 25.312-b07, mixed mode)

[sonalgoyal]

hmm..does cat file work fine in the docker?

[delgermurun]

just checked. Yes cat works fine in the docker.

[sonalgoyal]

@delgermurun let us run a few tests to narrow down this problem.

• update test.csv in examples/ febrl with the characters
• Run match and see what the output under /tmp/zinggOutput looks like
• Run findTrainingData and label and see what the console shows

[sonalgoyal]

@navinrathore have we tested the umlaut characters in docker?

[navinrathore]

Yes. It is reproducible in Docker image.
@delgermurun, we will work on it. Thanks.

[navinrathore]

@delgermurun , Please set the below environment variable for locale. Umlauts will be displayed on screen while Labeling.

export LANG=C.UTF-8

They are fine in Match output. It is just an issue related to display.

[sonalgoyal]

That’s a good find @navinrathore, can we set this in the docker file for the future as well?

[navinrathore]

Current locale setting on Docker image is:
$ locale
LANG=
LANGUAGE=
LC_CTYPE="POSIX"
LC_NUMERIC="POSIX"
LC_TIME="POSIX"

Current locale availability
$ locale -av
locale: C.UTF-8 directory: /usr/lib/locale/C.UTF-8

we will fix this issue in docker image. Thanks.

[delgermurun]

I can confirm that export LANG=C.UTF-8 works!

Thanks.

[sonalgoyal]

Awesome @delgermurun , thanks @navinrathore for the quick turnaround!