INVALID_CHARACTER_ERR when converting Document to W3C (different page)

[dportabella]

org.jsoup.nodes.Document doc = Jsoup.parse(new java.io.File("test.html"), null);
But trying to convert this to a W3C document fails:

new W3CDom().fromJsoup(doc);

Exception in thread "main" org.w3c.dom.DOMException: INVALID_CHARACTER_ERR: An invalid or illegal XML character is specified. 
	at org.apache.xerces.dom.CoreDocumentImpl.checkQName(Unknown Source)
	at org.apache.xerces.dom.ElementNSImpl.setName(Unknown Source)
	at org.apache.xerces.dom.ElementNSImpl.<init>(Unknown Source)
	at org.apache.xerces.dom.CoreDocumentImpl.createElementNS(Unknown Source)
	at org.jsoup.helper.W3CDom$W3CBuilder.head(W3CDom.java:94)
	at org.jsoup.select.NodeTraversor.traverse(NodeTraversor.java:45)
	at org.jsoup.helper.W3CDom.convert(W3CDom.java:64)
	at org.jsoup.helper.W3CDom.fromJsoup(W3CDom.java:45)

Is there a way to know where is the invalid or illegal XML charachter in the source html file (test.html)?

Can this be fixed?

test.html can be downloaded here: https://www.dropbox.com/s/w3zayut0kryy12s/test.html?dl=0

Note: I am using the latest version of jsoup.
Note: the example on #721 works well.

[jhy]

@dportabella apologies for the late reply. Do you still have that file or an example? Can you attach it here or on a gist, so it doesn't go away?

[smatei]

Hello @jhy,
I found a page that throws this error. I am using 1.13.1

html.zip

You can find it also here:
https://search.yahoo.co.jp/search?p=%E7%A5%9E%E7%94%B0+%E9%AB%98%E5%8F%8E%E5%85%A5+%E6%B1%82%E4%BA%BA&fr=top_ga1_sa&ei=UTF-8&mfb=P051&ts=641&aq=-1&oq=&at=&ai=0VH4FjPFQMG5Lv3SI1tFlA

The parser crashes with error, the browser does not care and displays <blabla!>

In order to avoid it, I had to cleanup the code, find non ascii tags with regex and replace them with &lt blabla &gt

Pattern pattern = Pattern.compile("<([^\\x00-\\x7F]+)>", Pattern.CASE_INSENSITIVE | Pattern.DOTALL);

[jhy]

Thanks! I've fixed this - now if a tag contains XML illegal names, we insert it as a textnode instead.