support funky Microsoft Word XHTML unicode escapes

[malsmith]

No description provided.

[malsmith]

These escape sequences are common in MS Word XHTML docs.

[coveralls]

Coverage increased (+0.06%) to 76.18% when pulling bfe6164 on malsmith:master into e902a7c on Alir3z4:master.

[coveralls]

Coverage increased (+0.06%) to 76.18% when pulling bfe6164 on malsmith:master into e902a7c on Alir3z4:master.

[coveralls]

Coverage increased (+0.06%) to 76.18% when pulling bfe6164 on malsmith:master into e902a7c on Alir3z4:master.

[coveralls]

Coverage increased (+0.06%) to 76.18% when pulling bfe6164 on malsmith:master into e902a7c on Alir3z4:master.

[coveralls]

Coverage increased (+0.06%) to 76.18% when pulling bfe6164 on malsmith:master into e902a7c on Alir3z4:master.

[Alir3z4]

@malsmith Could you please provide tests as well ?

[nikolas]

Maybe link to the share link for this question instead: http://stackoverflow.com/q/7105874/173630

[Alir3z4]

👍

[nikolas]

Will this fix this error I'm getting?

  File "/home/nnyby/src/dmt/dmt/main/migrations/0018_html2text.py", line 13, in populate_comment_src
    comment.comment.decode('unicode-escape'))
  File "/home/nnyby/src/dmt/ve/local/lib/python2.7/site-packages/html2text/__init__.py", line 794, in html2text
    return h.handle(html)
  File "/home/nnyby/src/dmt/ve/local/lib/python2.7/site-packages/html2text/__init__.py", line 122, in handle
    self.feed(data)
  File "/home/nnyby/src/dmt/ve/local/lib/python2.7/site-packages/html2text/__init__.py", line 119, in feed
    HTMLParser.HTMLParser.feed(self, data)
  File "/usr/lib/python2.7/HTMLParser.py", line 117, in feed
    self.goahead(0)
  File "/usr/lib/python2.7/HTMLParser.py", line 191, in goahead
    self.handle_charref(name)
  File "/home/nnyby/src/dmt/ve/local/lib/python2.7/site-packages/html2text/__init__.py", line 165, in handle_charref
    charref = self.charref(c)
  File "/home/nnyby/src/dmt/ve/local/lib/python2.7/site-packages/html2text/__init__.py", line 706, in charref
    return unichr(c)
ValueError: unichr() arg not in range(0x110000) (wide Python build)

[Alir3z4]

@nikolas Could you try this branch to see if it solve the issue you're facing ?

[theSage21]

@Alir3z4 I tried this branch, the issue is not solved. Failure at the struct module decode.

[Alir3z4]

I close this pull-request, the author of the patch @malsmith has not respond regarding to this patch and it comes with conflicts.