Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unicode stopped working for cygwin #2033

Closed
hartmark opened this issue Dec 18, 2019 · 12 comments
Closed

Unicode stopped working for cygwin #2033

hartmark opened this issue Dec 18, 2019 · 12 comments

Comments

@hartmark
Copy link

Versions

ConEmu build: 191012 x64
OS version: Windows 10 x64
Used shell version (Far Manager, cygwin

Problem description

Cygwin unicode seems to be broken after latest windows update for windows 10 on 1803 version.

I get just garbage characters when typing swedish characters like åäö and unicode is print out like garbage too.

The terminal task is set to the default:
set CHERE_INVOKING=1 & set "PATH=C:\cygwin64\bin;%PATH%" & %ConEmuBaseDir%\conemu-cyg-64.exe -new_console:p C:\cygwin64\bin\bash.exe --login -i -new_console:m:/cygdrive -new_console:C:"C:\cygwin64\Cygwin.ico"

Steps to reproduce

  1. Start cygwin bash
  2. type åäö

Actual results

get "åäö" printed out

Expected results

get "åäö" printed out

@Nebula-Mechanica
Copy link

I confirm this with Cyrillic, but this happen to me right after update to Cygwin 3.1, I guess it's the real source of problem. In cygwin-bundled mintty everything is fine.

@xylographe
Copy link
Contributor

xylographe commented Dec 19, 2019

Try chcp 65001. The UTF-8 byte sequence representing "ä" is C3 A4. If this byte sequence is decoded with Windows-1252 encoding, it is displayed as "ä".

@Nebula-Mechanica
Copy link

Oops, sorry. Cannot reproduce at home, will have to investigate further.

@hartmark
Copy link
Author

➜  kmha61 chcp
Active code page: 1252
➜  kmha61 chcp 65001
Active code page: 65001
➜  kmha61 chcp
Active code page: 1252
➜  kmha61

hmm, looks like chcp doesn't bite, it's getting reset to 1252

@tyan0
Copy link
Contributor

tyan0 commented Jan 6, 2020

  1. Could you please let us know the output of locale command?
  2. What is the default code page in command prompt?

@hartmark
Copy link
Author

hartmark commented Jan 9, 2020

$ locale
LANG=sv_SE.UTF-8
LC_CTYPE="sv_SE.UTF-8"
LC_NUMERIC="sv_SE.UTF-8"
LC_TIME="sv_SE.UTF-8"
LC_COLLATE="sv_SE.UTF-8"
LC_MONETARY="sv_SE.UTF-8"
LC_MESSAGES="sv_SE.UTF-8"
LC_ALL=

  1. Do you mean chcp in regular cmd prompt?
    Microsoft Windows [Version 10.0.17134.1184]
    (c) 2018 Microsoft Corporation. Med ensamrätt.

C:\Users\kmha61>chcp
Active code page: 850

@tyan0
Copy link
Contributor

tyan0 commented Jan 10, 2020

Thanks for the information. I can reproduce the problem in the environment which does not support pseudo console. I have just submitted a patch to cygwin-patches mailing list for this issue.

https://www.cygwin.com/ml/cygwin-patches/2020-q1/msg00011.html

Please wait for the new cygwin release.

@hartmark
Copy link
Author

wow! well spotted and fixed.

Is there a way to get a notification from cygwin when it's released?

@tyan0
Copy link
Contributor

tyan0 commented Jan 10, 2020

Is there a way to get a notification from cygwin when it's released?

Please check the cygwin mailing list:
https://www.cygwin.com/ml/cygwin-announce/

@tyan0
Copy link
Contributor

tyan0 commented Jan 15, 2020

A new cygwin has not yet been released, but a developer snapshot that fixes this problem is ready.
https://cygwin.com/snapshots/
Please test.

@hartmark
Copy link
Author

Sweet! It's working now.

$ åäö
$ chcp
Active code page: 65001

@tyan0
Copy link
Contributor

tyan0 commented Jan 17, 2020

Thanks for testing!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants