Improve UTF-8 Decoding Accuracy for Binary Data

[HsuMsix]

Problem:

Currently, the application uses String.fromCharCode.apply(null, new Uint8Array(...)) to convert binary data from network requests into strings. This approach, however, has proven to be unreliable for UTF-8 encoded text, especially when dealing with non-ASCII characters such as Chinese characters, leading to garbled text outputs.

Proposed Solution:

It is suggested that we switch to using the TextDecoder API for decoding binary data. The TextDecoder interface provides a more robust mechanism for handling UTF-8 encoded text, ensuring accurate representation of all characters, including those outside the ASCII range.

For Example:

In background.js, line 109

var postedString = String.fromCharCode.apply(null,new Uint8Array(details.requestBody.raw[0].bytes));

change to

var bytes = new Uint8Array(details.requestBody.raw[0].bytes);
var decoder = new TextDecoder('utf-8');
var postedString = decoder.decode(bytes);

Results

If you have any questions, please let me know. Thank you!