Git in cmd.exe console have wrong encoding.

[lygstate]

C:\Users\luoyonggang>git
usage: git [--version] [--help] [-C ] [-c name=value]
[--exec-path[=]] [--html-path] [--man-path] [--info-path]
[-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
[--git-dir=] [--work-tree=] [--namespace=]
[]

×ÓõÄ git ÃüÁîÓУº
add Ìí¼ÓÎļþÄÚÈÝÖÁË÷Òý
bisect ͨ¹ý¶þ·ֲéÕҶ¨λÒýÈë bug µıä¸ü
branch Áгö¡¢´´½¨»òɾ³ý·Ö֧
checkout ¼ì³öһ¸ö·Ö֧»ò·¾¶µ½¹¤×÷Çø
clone ¿Ë¡һ¸ö°汾¿⵽һ¸öÐÂĿ¼
commit ¼Ç¼±ä¸üµ½°汾¿â
diff ÏÔʾÌύ֮¼䡢Ìύº͹¤×÷Çø֮¼äµȵIJîÒì
fetch ´ÓÁíÍâһ¸ö°汾¿âÏÂÔضÔÏóºÍÒýÓÃ
grep Êä³öºÍģʽƥÅäµÄÐÐ
init ´´½¨һ¸ö¿յÄ Git °汾¿â»òÖØгõʼ»¯һ¸öÒѴæÔڵİ汾¿â
log ÏÔʾÌύÈÕ־
merge ºϲ¢Á½¸ö»ò¸ü¶࿪·¢Àúʷ
mv Òƶ¯»òÖØÃüÃûһ¸öÎļþ¡¢Ŀ¼»ò·ûºÅÁ´½Ó
pull »ñȡ²¢ÕûºÏÁíÍâµİ汾¿â»òһ¸ö±¾µطÖ֧
push ¸üÐÂԶ³ÌÒýÓúÍÏà¹صĶÔÏó
rebase ±¾µØÌύתÒÆÖÁ¸üкóµÄÉÏÓηÖ֧ÖÐ
reset ÖØÖõ±ǰHEADµ½ָ¶¨״̬
rm ´ӹ¤×÷ÇøºÍË÷ÒýÖÐɾ³ýÎļþ
show ÏÔʾ¸÷ÖÖÀàÐ͵ĶÔÏó
status ÏÔʾ¹¤×÷Çø״̬
tag ´´½¨¡¢Áгö¡¢ɾ³ý»òУÑéһ¸öGPGǩÃûµÄ tag ¶ÔÏó

ÃüÁî 'git help -a' ºÍ 'git help -g' ÏÔʾ¿ÉÓõÄ×ÓÃüÁîºÍһЩ¸ÅÄî°ïÖú¡£
²鿴 'git help <ÃüÁî>' »ò 'git help <¸ÅÄî>' ÒԻñȡ¸ø¶¨×ÓÃüÁî»ò¸ÅÄîµÄ
°ïÖú¡£

Warning: Your console font probably doesn't support Unicode. If you experience strange characters in the output, consider switching to a TrueType font
such as Consolas!

C:\Users\luoyonggang>

[sschuberth]

Have you read the warning and ensured that your console font supports Unicode? If not, there nothing Git can do about it.

[lygstate]

@sschuberth I am familiar with this issue, this comes from the fact, If you want to output correct unicode things into cmd.exe console, we should not directly output UTF8 string, instead, we need to
output UTF16 string directly.

[dscho]

@lygstate this is really a developers' preview. If you want to see this bug fixed, this is the perfect time to start digging into the code.

[lygstate]

@dscho Thanks for your works, I am busy on something, when I am free, I'll dig into this.

[lygstate]

Looks like not the msys2 problem, it's just comes from the git.

bash: cls: 未找到命令
 MINGW64 ~ (master)
$ git
usage: git [--version] [--help] [-C <path>] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]

▒▒õ▒ git ▒▒▒▒▒У▒
   add        ▒▒▒▒ļ▒▒▒▒▒▒▒▒▒▒▒
   bisect     ͨ▒▒▒▒▒ֲ▒▒Ҷ▒λ▒▒▒▒ bug ▒ı▒▒
   branch     ▒г▒▒▒▒▒▒▒▒▒ɾ▒▒▒▒֧
   checkout   ▒▒▒һ▒▒▒▒֧▒▒·▒▒▒▒▒▒▒▒▒▒
   clone      ▒▒¡һ▒▒▒汾▒⵽һ▒▒▒▒Ŀ¼
   commit     ▒▒¼▒▒▒▒▒▒汾▒▒
   diff       ▒▒ʾ▒ύ֮▒䡢▒ύ▒͹▒▒▒▒▒֮▒▒ȵIJ▒▒▒
   fetch      ▒▒▒▒▒▒һ▒▒▒汾▒▒▒▒▒ض▒▒▒▒▒▒▒▒
   grep       ▒▒▒▒▒ģʽƥ▒▒▒▒▒
   init       ▒▒▒▒һ▒▒▒յ▒ Git ▒汾▒▒▒▒▒▒³▒ʼ▒▒һ▒▒▒Ѵ▒▒ڵİ汾▒▒
   log        ▒▒ʾ▒ύ▒▒־
   merge      ▒ϲ▒▒▒▒▒▒▒▒▒࿪▒▒▒▒ʷ
   mv         ▒ƶ▒▒▒▒▒▒▒▒▒һ▒▒▒ļ▒▒▒Ŀ¼▒▒▒▒▒▒▒▒▒
   pull       ▒▒ȡ▒▒▒▒▒▒▒▒▒▒İ汾▒▒▒һ▒▒▒▒▒ط▒֧
   push       ▒▒▒▒Զ▒▒▒▒▒ú▒▒▒صĶ▒▒▒
   rebase     ▒▒▒▒▒ύת▒▒▒▒▒▒▒º▒▒▒▒▒η▒֧▒▒
   reset      ▒▒▒õ▒ǰHEAD▒▒ָ▒▒״̬
   rm         ▒ӹ▒▒▒▒▒▒▒▒▒▒▒▒▒ɾ▒▒▒ļ▒
   show       ▒▒ʾ▒▒▒▒▒▒▒͵Ķ▒▒▒
   status     ▒▒ʾ▒▒▒▒▒▒״̬
   tag        ▒▒▒▒▒▒▒г▒▒▒ɾ▒▒▒▒У▒▒һ▒▒GPGǩ▒▒▒▒ tag ▒▒▒▒

▒▒▒▒ 'git help -a' ▒▒ 'git help -g' ▒▒ʾ▒▒▒õ▒▒▒▒▒▒▒▒һЩ▒▒▒▒▒▒▒▒▒
▒鿴 'git help <▒▒▒▒>' ▒▒ 'git help <▒▒▒▒>' ▒Ի▒ȡ▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒
▒▒▒▒▒▒

 MINGW64 ~ (master)
$

[evieluvsrainbows]

@lygstate then fix it. However, your font might actually be messed up, because this isn't happening on my machine.

[lygstate]

@KamranMackey which langauge you are using? I am RPC/ code page 936

[dscho]

when I am free, I'll dig into this.

Please do. This project cannot work any other way.

[lygstate]

@dscho
It's seems the building procedure already have the problem

Generating catalog po/ru.msg
msgfmt --statistics --tcl po/ru.po -l ru -d po/
Generating catalog po/bg.msg
msgfmt --statistics --tcl po/bg.po -l bg -d po/
Generating catalog po/pt_br.msg
msgfmt --statistics --tcl po/pt_br.po -l pt_br -d po/
    * new Tcl/Tk interpreter location
Generating catalog po/ja.msg
msgfmt --statistics --tcl po/ja.po -l ja -d po/
Generating catalog po/it.msg
msgfmt --statistics --tcl po/it.po -l it -d po/
245 ▒▒▒ѷ▒▒▒▒▒Ϣ.
284 ▒▒▒ѷ▒▒▒▒▒Ϣ.
Generating catalog po/fr.msg
msgfmt --statistics --tcl po/fr.po -l fr -d po/
Generating catalog po/sv.msg
msgfmt --statistics --tcl po/sv.po -l sv -d po/
302 ▒▒▒ѷ▒▒▒▒▒Ϣ.
290 ▒▒▒ѷ▒▒▒▒▒Ϣ.
Generating catalog po/es.msg
msgfmt --statistics --tcl po/es.po -l es -d po/
Generating catalog po/hu.msg
283 ▒▒▒ѷ▒▒▒▒▒Ϣ▒▒6 ▒▒δ▒▒▒▒▒▒Ϣ.
msgfmt --statistics --tcl po/hu.po -l hu -d po/
Generating catalog po/vi.msg
msgfmt --statistics --tcl po/vi.po -l vi -d po/
200 ▒▒▒ѷ▒▒▒▒▒Ϣ▒▒7 ▒▒δ▒▒▒▒▒▒Ϣ.
276 ▒▒▒ѷ▒▒▒▒▒Ϣ▒▒4 ▒▒ģ▒▒▒▒Ϣ.
Generating catalog po/de.msg
304 ▒▒▒ѷ▒▒▒▒▒Ϣ.
msgfmt --statistics --tcl po/de.po -l de -d po/
288 ▒▒▒ѷ▒▒▒▒▒Ϣ.
    GEN gitk-wish
304 ▒▒▒ѷ▒▒▒▒▒Ϣ.
289 ▒▒▒ѷ▒▒▒▒▒Ϣ.
    SUBDIR perl
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/I18N.pm >blib/lib/Git/I18N.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Memoize/YAML.pm >blib/lib/Git/SVN/Memoize/YAML.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/IndexInfo.pm >blib/lib/Git/IndexInfo.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Prompt.pm >blib/lib/Git/SVN/Prompt.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Fetcher.pm >blib/lib/Git/SVN/Fetcher.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN.pm >blib/lib/Git/SVN.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Utils.pm >blib/lib/Git/SVN/Utils.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Migration.pm >blib/lib/Git/SVN/Migration.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Editor.pm >blib/lib/Git/SVN/Editor.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git.pm >blib/lib/Git.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Ra.pm >blib/lib/Git/SVN/Ra.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/Log.pm >blib/lib/Git/SVN/Log.pm
/usr/bin/perl.exe -pe "s<\Q++LOCALEDIR++\E></mingw64/share/locale>" <Git/SVN/GlobSpec.pm >blib/lib/Git/SVN/GlobSpec.pm
Manifying blib/man3/Git.3pm
Manifying blib/man3/Git.I18N.3pm
Manifying blib/man3/Git.SVN.Editor.3pm
Manifying blib/man3/Git.SVN.Fetcher.3pm
Manifying blib/man3/Git.SVN.Memoize.YAML.3pm
Manifying blib/man3/Git.SVN.Prompt.3pm
Manifying blib/man3/Git.SVN.Ra.3pm

[lygstate]

The problem comes from the third party program

$ msgfmt --help
▒÷▒▒▒C:\CI-Tools\vcs\Git-New\mingw64\bin\msgfmt.exe [ѡ▒▒] ▒ļ▒▒▒.po ...

▒▒▒▒▒▒ģʽ▒▒▒▒▒▒▒ɶ▒▒▒▒▒▒▒Ϣ▒ļ▒▒▒

▒▒ѡ▒▒▒▒▒▒õIJ▒▒▒▒▒ʹ▒ö▒ѡ▒▒ʱҲ▒DZ▒▒▒ġ▒
▒▒ѡ▒▒▒▒Ҳ▒▒▒▒ˡ▒

▒▒▒▒▒ļ▒▒▒λ▒ã▒
  ▒ļ▒▒▒.po ...               ▒▒▒▒▒ļ▒
  -D, --directory=Ŀ¼        ▒▒<Ŀ¼>▒в▒▒▒▒▒▒▒▒ļ▒
▒▒▒▒▒▒▒▒ļ▒Ϊ -▒▒▒򽫶▒ȡ▒▒׼▒▒▒롣

▒▒▒▒ģʽ▒▒
  -j, --java                  Java ģʽ▒▒▒▒▒▒ Java ▒▒Դ▒▒▒▒
      --java2                 ▒▒▒▒ --java▒▒▒▒▒▒▒▒▒▒ Java2 (JDK 1.2 ▒▒▒▒▒
                              ▒İ汾)
      --csharp                C# ģʽ▒▒▒▒▒▒ .NET .dll ▒ļ▒
      --csharp-resources      C# ▒▒Դģʽ▒▒▒▒▒▒ .NET .resources ▒ļ▒
      --tcl                   Tcl ģʽ▒▒▒▒▒▒ tcl/msgcat .msg ▒ļ▒
      --qt                    Qt ģʽ▒▒▒▒▒▒ Qt .qm ▒ļ▒
      --desktop               Desktop Entry mode: generate a .desktop file

▒▒▒▒ļ▒λ▒ã▒
  -o, --output-file=▒ļ▒      ▒▒▒▒▒д▒▒ָ▒▒▒ļ▒
      --strict                ʹ▒▒▒ϸ▒▒ Uniforum ģʽ
▒▒▒▒▒▒▒ļ▒▒▒ -▒▒▒▒Ὣ▒▒▒д▒▒▒▒▒▒׼▒▒▒▒▒

▒▒ Java ģʽ▒▒▒▒ļ▒λ▒ã▒
  -r, --resource=▒▒Դ         ▒▒Դ▒▒▒▒
  -l, --locale=▒▒ϵ           ▒▒ϵ▒▒▒ƣ▒▒▒▒▒▒ǡ▒▒▒▒ԡ▒▒▒▒▒▒▒_▒▒▒ҡ▒▒ĸ▒ʽ
      --source                produce a .java file, instead of a .class file
  -d Ŀ¼                     ▒▒Ŀ¼▒▒εĻ▒▒▒Ŀ¼
▒▒▒▒▒▒▒▒▒▒▒▒Դ▒▒▒▒▒▒ͬ▒▒ϵ▒▒▒ƹ▒ͬ▒▒▒▒▒ģ▒▒▒▒▒֮▒▒▒▒▒▒»▒▒߷ָ▒▒▒
-d ѡ▒▒▒DZ▒▒▒ġ▒class ▒ļ▒▒▒▒▒▒▒ָ▒▒▒▒Ŀ¼▒▒

▒▒ C# ģʽ▒▒▒▒ļ▒λ▒ã▒
  -r, --resource=▒▒Դ         ▒▒Դ▒▒▒▒
  -l, --locale=▒▒ϵ           ▒▒ϵ▒▒▒ƣ▒▒▒▒▒▒ǡ▒▒▒▒ԡ▒▒▒▒▒▒▒_▒▒▒ҡ▒▒ĸ▒ʽ
  -d Ŀ¼                     ▒▒▒▒▒▒ϵ▒▒ .dll ▒ļ▒▒ĵĻ▒▒▒Ŀ¼
-l ▒▒ -d ѡ▒▒▒DZ▒Ҫ▒ġ▒.dll ▒ļ▒▒▒д▒▒ָ▒▒Ŀ¼▒▒▒▒Ŀ¼▒▒▒▒▒▒Ŀ¼▒▒▒▒▒▒ȡ▒▒▒▒▒▒ϵ▒▒

▒▒ Tcl ģʽ▒▒▒▒ļ▒λ▒ã▒
  -l, --locale=▒▒ϵ           ▒▒ϵ▒▒▒ƣ▒▒▒▒▒▒ǡ▒▒▒▒ԡ▒▒▒▒▒▒▒_▒▒▒ҡ▒▒ĸ▒ʽ
  --d Ŀ¼                    .msg ▒▒Ϣ▒▒Ļ▒▒▒Ŀ¼
-l ▒▒ -d ѡ▒▒▒DZ▒Ҫ▒ġ▒▒▒▒▒▒ɵ▒ .msg ▒ļ▒▒▒▒▒▒▒ָ▒▒▒▒Ŀ¼▒▒

Desktop Entry mode options:
  -l, --locale=▒▒ϵ           ▒▒ϵ▒▒▒ƣ▒▒▒▒▒▒ǡ▒▒▒▒ԡ▒▒▒▒▒▒▒_▒▒▒ҡ▒▒ĸ▒ʽ
  -o, --output-file=▒ļ▒      ▒▒▒▒▒д▒▒ָ▒▒▒ļ▒
  --template=TEMPLATE         a .desktop file used as a template
  -d DIRECTORY                base directory of .po files
  -kWORD, --keyword=WORD      ▒▒▒▒ WORD ▒▒Ϊһ▒▒▒▒▒▒Ĺؼ▒▒▒
  -k, --keyword               ▒▒ʹ▒▒Ĭ▒Ϲؼ▒▒▒
The -l, -o, and --template options are mandatory.  If -D is specified, input
files are read from the directory instead of the command line arguments.

▒▒▒▒▒ļ▒▒▒▒�▒▒
  -P, --properties-input      ▒▒▒▒▒ļ▒▒▒ Java .properties ▒�▒▒▒▒
      --stringtable-input     ▒▒▒▒▒ļ▒▒▒ NeXTstep/GNUstep .strings ▒�▒▒▒▒

▒▒▒▒▒ļ▒▒Ľ▒▒ͣ▒
  -c, --check                 ͬʱ▒▒▒▒ --check-format▒▒--check-header ▒▒
                                --check-domain ▒▒▒ּ▒▒
      --check-format          ▒▒▒▒▒▒▒▒▒йصĸ▒ʽ▒ַ▒▒▒
      --check-header          ▒▒▒▒ļ▒ͷ▒▒▒Ƿ▒▒▒ڼ▒▒▒▒▒▒▒▒▒▒
      --check-domain          ▒▒▒ domain ָ▒▒▒ --output-file ѡ▒▒֮▒▒
                                ▒Ƿ▒▒ͻ
  -C, --check-compatibility   ▒▒ GNU msgfmt ▒▒ X/Open msgfmt ▒ķ▒ʽ▒▒▒▒ļ▒
      --check-accelerators[=CHAR]  ▒▒▒˵▒▒▒Ŀ▒еĿ▒ݼ▒▒▒▒▒Ƿ▒▒▒▒
  -f, --use-fuzzy             ▒▒▒▒▒▒▒ʹ▒▒ģ▒▒▒ķ▒▒▒▒▒Ŀ

▒▒▒ϸ▒ڣ▒
  -a, --alignment=▒▒▒▒        ▒▒<▒▒▒▒>▒▒▒ֽ▒Ϊ▒▒λ▒▒▒▒▒ַ▒▒▒(Ĭ▒ϣ▒1)
      --endianness=BYTEORDER  ▒▒ָ▒▒▒ֽ▒▒▒▒▒▒ 32λ▒▒
                                (big ▒▒▒▒ little ▒▒ϵͳƽ̨Ĭ▒ϵ▒)
      --no-hash               ▒▒▒▒▒▒▒ļ▒▒▒▒▒▒▒▒▒▒▒ϣ▒▒

▒▒Ϣ▒▒▒▒▒▒▒
  -h, --help                  ▒▒ʾ▒˰▒▒▒▒▒▒˳▒
  -V, --version               ▒▒▒▒汾▒▒Ϣ▒▒▒˳▒
      --statistics            ▒▒ӡ▒▒▒ڷ▒▒▒▒ͳ▒▒
  -v, --verbose               ▒▒▒▒▒▒▒▒▒▒▒ϸ▒̶▒

▒▒▒▒▒󱨸▒▒▒ <bug-gnu-gettext@gnu.org>▒▒

[dscho]

For the record, I still have no Minimal, Complete, and Verifiable example.

[lygstate]

@dscho You can not reproduce it cause your locales is not chinese,
Open mingw64_shell.bat

$ echo $LANG
zh_CN.UTF-8
$export LANG=zh_CN.UTF-8
msgfmt
``
This procedure will reproduce the problem if you are lucky

[dscho]

This procedure will reproduce the problem if you are lucky

Hmm. I do not really feel that you have a lot of respect for my time here.