Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

japanese characters are turned to ? #50

Closed
gerald27 opened this issue Jan 8, 2016 · 3 comments
Closed

japanese characters are turned to ? #50

gerald27 opened this issue Jan 8, 2016 · 3 comments

Comments

@gerald27
Copy link

gerald27 commented Jan 8, 2016

Hi,

I'm using your library and it works but I only have one problem when I enter chinese or japanese characters it converted to "?". Any solution for this?

Thanks

@peter-p2people
Copy link

Hi,

I have the same problem. The library solves my encoding problems with Latin-based languages, but when it encounters Asian script, it outputs "???". Is there a fix to recognize these UTF-8 characters?

Thanks,

@neitanod
Copy link
Owner

Are you using toUTF() or fixUTF8() ?

@neitanod
Copy link
Owner

As I said in another open issue, I should probably remove fixUFT8() from this package, because as the documentation says, it's not intended for a production environment.
I did it to fix a set of broken files that I was able to check afterwards. It's useful if your text has occidental characters only, but will break things in other cases, so It's not really supposed to be left runing unattended on any input that may come.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants