-
-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for malayalam characters #4
Comments
Some errors I faced
Rust Users Forum#1909 is a discussion I can point to and the one pointer I could figure out is that using |
Yes.I have started the work on malayalam-characters,I'll merge it to master after the work is done :) |
Ok this comes with some limitation.The encoding of source code to ASCII,can lead to encoding of string literals too.This should be avoided.One of possible solution that comes to my mind is to create a literal table,before tokenizing the source unit,and replace the literals with reference to corresponding value in table. |
Here's a simple example in pure Malayalam keyword. |
No description provided.
The text was updated successfully, but these errors were encountered: