UTF8 encoding messy code

[xiaoxstz]

Summary

It does not support utf-8 encoding yet?

Expected

When running scripts with Chinese strings, it would come across messy code issues.

For example, the script below.

print("测试中文")

# coding=utf-8
print("测试中文")

The output is:

娴嬭瘯涓枃

Actual

Python Documentation

[youknowone]

RustPython (almost) only support utf-8 and ascii. Would you check if your source code is a correct utf-8 file? If you keep having the problem, please upload the source code file too. It will be really helpful.

Welcome to the magnificent Rust Python 0.3.0 interpreter 😱 🖖
RustPython 3.12.0
Type "help", "copyright", "credits" or "license" for more information.
>>>>> print("测试中文")
测试中文
>>>>> 

❯ ./target/debug/rustpython test_utf8_zh.py
测试中文

[xiaoxstz]

My Environment

• OS：Windows 10 pro 22H2
• How to install RustPython

# Install rust
scoop install main/rust
# Install the latest RustPython
cargo install --git https://github.com/RustPython/RustPython

File encoding

I have ensured the encoding of the Python script file is utf8

Other related issue

I have also found the issue in the interactive panel

D:\Desktop                                                             
λ RustPython                                                           
Welcome to the magnificent Rust Python 0.3.0 interpreter � �           
RustPython 3.12.0                                                      
Type "help", "copyright", "credits" or "license" for more information. 
>>>>> print("测试中文")                                                    
娴嬭瘯涓枃                                                                 
>>>>>