Wafw00f fails to execute on multiple sites

[gh0stwr1ter]

Getting the following output when running the tool against different sites.

root@kali:~# wafw00f -a https://google.com -v
Traceback (most recent call last):
File "/usr/local/bin/wafw00f", line 4, in
import('pkg_resources').run_script('wafw00f==0.9.4', 'wafw00f')
File "/usr/lib/python2.7/dist-packages/pkg_resources/init.py", line 739, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/lib/python2.7/dist-packages/pkg_resources/init.py", line 1494, in run_script
exec(code, namespace, namespace)
File "/usr/local/lib/python2.7/dist-packages/wafw00f-0.9.4-py2.7.egg/EGG-INFO/scripts/wafw00f", line 4, in
from wafw00f import main
File "/usr/local/lib/python2.7/dist-packages/wafw00f-0.9.4-py2.7.egg/wafw00f/main.py", line 53, in
from wafw00f.lib.evillib import oururlparse, scrambledheader, waftoolsengine
File "/usr/local/lib/python2.7/dist-packages/wafw00f-0.9.4-py2.7.egg/wafw00f/lib/evillib.py", line 14, in
from bs4 import BeautifulSoup
File "build/bdist.linux-x86_64/egg/bs4/init.py", line 30, in
File "build/bdist.linux-x86_64/egg/bs4/builder/init.py", line 314, in
File "build/bdist.linux-x86_64/egg/bs4/builder/_html5lib.py", line 70, in
AttributeError: 'module' object has no attribute '_base'

[sandrogauci]

I am not getting this output on my machine. The problem might be related to beautiful soup on Kali. Will test and revert back

[sandrogauci]

I made use of the latest Kali live CD and also could not reproduce your problem. This does not appear to be a wafw00f issue or a Kali linux issue (which is beyond our control anyway). Having said that, a quick google search shows that this is related to beautifulsoup. See this. Solution they say, is to upgrade your beautifulsoup4 and html5lib as follows:

pip install --upgrade beautifulsoup4
pip install --upgrade html5lib

[sandrogauci]

fixed #38