Adjust heuristic to properly handle unicode characters

[yurydelendik]

Fixes #1721

(heuristics introduced to fix #1597 / pull #1599)

[yurydelendik]

/botio test

[pdfjsbot]

From: Bot.io (Windows)

---

Received

Command cmd_test from @yurydelendik received. Current queue size: 0

Live output at: http://107.22.172.223:8877/940be0df30e7507/output.txt

[pdfjsbot]

From: Bot.io (Linux)

---

Received

Command cmd_test from @yurydelendik received. Current queue size: 0

Live output at: http://107.21.233.14:8877/c3b409f87659c72/output.txt

[pdfjsbot]

From: Bot.io (Windows)

---

Success

Full output at http://107.22.172.223:8877/940be0df30e7507/output.txt

Total script time: 13.95 mins

• Lint: Passed
• Unit tests: Passed
• Regression tests: Passed

[pdfjsbot]

From: Bot.io (Linux)

---

Failed

Full output at http://107.21.233.14:8877/c3b409f87659c72/output.txt

Total script time: 19.84 mins

• Lint: Passed
• Unit tests: Passed
• Regression tests: FAILED

Image differences available at: http://107.21.233.14:8877/c3b409f87659c72/reftest-analyzer.xhtml#web=eq.log

[yurydelendik]

Can fix #1742

[brendandahl]

/botio makeref

[pdfjsbot]

From: Bot.io (Windows)

---

Received

Command cmd_makeref from @brendandahl received. Current queue size: 0

Live output at: http://107.22.172.223:8877/e10bb4cb35ac8b2/output.txt

[pdfjsbot]

From: Bot.io (Linux)

---

Received

Command cmd_makeref from @brendandahl received. Current queue size: 0

Live output at: http://107.21.233.14:8877/6ec1cedbe94c882/output.txt

[pdfjsbot]

From: Bot.io (Windows)

---

Success

Full output at http://107.22.172.223:8877/e10bb4cb35ac8b2/output.txt

Total script time: 13.83 mins

• Lint: Passed
• Make references: Passed
• Check references: Passed

[pdfjsbot]

From: Bot.io (Linux)

---

Success

Full output at http://107.21.233.14:8877/6ec1cedbe94c882/output.txt

Total script time: 19.68 mins

• Lint: Passed
• Make references: Passed
• Check references: Passed