ImportError with html5lib 0.99999999 (2016-07-14)

[ivan]

html5lib 0.99999999 renamed html5lib.tokenizer:

Move a whole load of stuff (inputstream, ihatexml, trie, tokenizer, utils) to be underscore prefixed to clarify their status as private.

https://pypi.python.org/pypi/html5lib

and thus wpull crashes with ImportError on startup:

  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/click/core.py", line 716, in __call__
    return self.main(*args, **kwargs)
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/click/core.py", line 696, in main
    rv = self.invoke(ctx)
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/click/core.py", line 889, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/libgrabsite/main.py", line 368, in main
    wpull.__main__.main()
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/wpull/__main__.py", line 29, in main
    builder.build()
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/wpull/builder.py", line 195, in build
    self._build_html_parser()
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/wpull/builder.py", line 692, in _build_html_parser
    from wpull.document.htmlparse.html5lib_ import HTMLParser
  File "/home/travis/virtualenv/python3.4.2/lib/python3.4/site-packages/wpull/document/htmlparse/html5lib_.py", line 3, in <module>
    import html5lib.tokenizer
ImportError: No module named 'html5lib.tokenizer'

(That's a traceback from wpull 1.2.3, but it looks like wpull 2.0.1 has the same import.)

[anarcat]

workaround for this:

pip3 install 'html5lib<=0.9999999'

It would be great to see a release with this and #384 because right now, out of the box, wpull just fails to pip install itself...