Flutter Engine build failure: UnicodeDecodeError: 'cp949' codec can't decode byte 0xe2 in position 1001: illegal multibyte sequence

[p1318k]

Is there an existing issue for this?

• I have searched the existing issues
• I have read the guide to filing a bug

Steps to reproduce

I performed a build on Windows following the Flutter Engine Build Guide(https://github.com/flutter/flutter/wiki/Compiling-the-engine#compiling-for-windows). However, I encountered the following build error, and it did not proceed further.

Expected results

build success

Actual results

build failed

Code sample

nothing

Screenshots or Video

Screenshots / Video demonstration

[Upload media here]

Logs

Logs

PS C:\engine\src> ninja -C .\out\host_debug_unopt\
ninja: Entering directory `.\out\host_debug_unopt\'
[1/6284] ACTION //third_party/angle:angle_program_version_id(//build/toolchain/win:clang_x64)
FAILED: gen/angle/ANGLEShaderProgramVersion.h
C:/Users/kimki/.vpython-root/3a4476/Scripts/python.exe ../../third_party/angle/src/program_serialize_data_version.py gen/angle/ANGLEShaderProgramVersion.h gen/angle_code_affecting_program_serialize
Traceback (most recent call last):
  File "../../third_party/angle/src/program_serialize_data_version.py", line 40, in <module>
    angle_shader_program_version_hash_result = GenerateHashOfAffectedFiles(angle_code_files)
  File "../../third_party/angle/src/program_serialize_data_version.py", line 18, in GenerateHashOfAffectedFiles
    for chunk in iter(lambda: f.read(4096), ""):
  File "../../third_party/angle/src/program_serialize_data_version.py", line 18, in <lambda>
    for chunk in iter(lambda: f.read(4096), ""):
UnicodeDecodeError: 'cp949' codec can't decode byte 0xe2 in position 1001: illegal multibyte sequence

Flutter Doctor output

Doctor output

[Paste your output here]

[p1318k]

It worked by modifing "program_serialize_data_version.py".
I cannot find a way to make a pull request for flutter engine.
So, I leave a comment here.

[Before]
def GenerateHashOfAffectedFiles(angle_code_files):
hash_md5 = hashlib.md5()
for file in angle_code_files:
assert (file != "")
with open(file, 'r') as f:
for chunk in iter(lambda: f.read(4096), ""):
hash_md5.update(chunk.encode())
return hash_md5.hexdigest(), hash_md5.digest_size

[After] : add {encoding='UTF-8} as a parameter for opening file.
def GenerateHashOfAffectedFiles(angle_code_files):
hash_md5 = hashlib.md5()
for file in angle_code_files:
assert (file != "")
with open(file, 'r', encoding='UTF-8') as f:
for chunk in iter(lambda: f.read(4096), ""):
hash_md5.update(chunk.encode())
return hash_md5.hexdigest(), hash_md5.digest_size

[huycozy]

Hi @p1318k, thanks for your report.
Adding encoding seems to be a reasonable fix. But can you please be more specific about:

• What is your current Python version?
• Did you make any modifications to the engine that you built?
• Which engine hash are you building at?

[p1318k]

Hi @p1318k, thanks for your report. Adding encoding seems to be a reasonable fix. But can you please be more specific about:

• What is your current Python version?
• Did you make any modifications to the engine that you built?
• Which engine hash are you building at?

@huycozy Please refer to the following answer.

• Python3.11
• No other modifications.
• flutter engine repo hash : 470652849224c3a94b1a6b2ee8c1ad71655080de

Feel free to ask me if you need more information.

[huycozy]

Per Compiling for Windows:

Also, be sure that Python27 is before any other python in your Path.

Could you retry this with Python 2 to see if it works? (also see this SO answer)

[p1318k]

Per Compiling for Windows:

Also, be sure that Python27 is before any other python in your Path.

Could you retry this with Python 2 to see if it works? (also see this SO answer)

It is same with Python2. It seems not depend on Python version.

[huycozy]

Thanks for checking it. Labeling the issue to have more insights.