When bundling files encoded as UTF-8 with a byte order marker, BOMs are retained

[nrkn]

Some UTF-8 encoded files include a byte order marker at the beginning. These are retained when bundling causing a SyntaxError: illegal character error when the script is executed.

Although you're not using fs.readFileSync it's a similar issue to nodejs/node-v0.x-archive#1918

[ForbesLindesay]

👍

[dominictarr]

utf-8 is hard. can you provide a file with such a marker, or a script to add one to a file?

[ForbesLindesay]

This is the code I've used to remove it in the past:

function stripBOM(str){
  return 0xFEFF == str.charCodeAt(0)
    ? str.substring(1)
    : str;
}

This should add one:

function addBOM(str){
  return '\ufeff' + stripBOM(str);
}

[ghost]

Fixed in 3.11.1 with a test too.