pip install selenium pip install bs4 pip install json
ChromeDriver were used because I used to use chrome to search google(fxxk G F W). It's OK for Firefox or other browsers if you can use it for searching google. Remember to put
$PATH before starting selenium.
Remove json file can result in searching all queries, or only queries with "NA" or "None" address would be scanned.
2. Run script:
This script may have to be re-run for many times in order to continue a interupted scanning.
main.py, two browsers would be openned. For the testing data:
And these gif were generated using makeGif.py. This scripts usedimages2gif, however, a bug have to be fixed: http://stackoverflow.com/questions/19149643/error-in-images2gif-py-with-globalpalette