Internationalized domainnames results in breaking up the domainname

[emilhem]

When going to domains with internationalized domainnames such as http://www.vårdverktyget.se/ it causes unblocker to redirect to http://www.v/årdverktyget.se/ instead making unblocker trying to connect to the domain www.v instead of www.xn--vrdverktyget-tcb.se.

I might look into this at a later time unless you get to it first.

Look into Punycode: https://en.wikipedia.org/wiki/Punycode

Possible module: https://www.npmjs.com/package/punycode

[nfriedly]

Hum. I'm not sure how that's happening, but yea, please take a look. require('url').parse('http://www.vårdverktyget.se/') correctly de-punycodes it, which is mostly what I use internally.. but there's probably something somewhere that doesn't handle it correctly.

[emilhem]

The browsers send characters like åäö URI encoded.

I tried setting

clientRequest.url = decodeURIComponent(clientRequest.url)

Between line 114 and 116 in unblocker.js and it somewhat works but creates different errors.

Putting in http://www.vårdverktyget.se/this/path/?why=dåes&thisz=nottåäö#work=måäö results in redirection to http://www.xn--vrdverktyget-tcb.se/this/path/?why=d%E5es&thisz=nott%E5%E4%F6#work=m%C3%A5%C3%A4%C3%B6 and an error URIError: URI malformed

Reference: https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/decodeURIComponent