Crawler that scans all the websites on a given list and extracts, with the help of a web driver, the JavaScript files of the page source.
- Selenium
- BeautifulSoup
- tqdm
Clone repository:
git clone https://github.com/Jael-G/JS_Crawler
Go into de repository file:
cd JS_Crawler
Install the requirements:
sudo ./requirements.sh