Skip to content

Tinoco/Ticapsoriginal_selenium_sitemaps_driver

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

Ticapsoriginal Selenium Sitemaps Driver

Ticapsoriginal Selenium Driving on all Urls of Large Sitemaps

Features :

  • only one mac adress and ip acess
  • ideal for activating all pages script
  • nice to test many requests per day

make python environment:

  • Install pip first:
sudo apt-get install python3-pip
  • Then install virtualenv using pip3
sudo pip3 install virtualenv 
  • Now create a virtual environment
virtualenv venv
  • Active your virtual environment:
source venv/bin/activate
  • Enter on environment:
cd venv

Install selenium to make webdriver works:

pip install selenium

Install tqdm to see progress bar:

pip install tqdm

Install advertools to read large url data:

pip install advertools

Clone ticapsoriginal Selenium sitemaps driver repository:

 git clone https://github.com/Tinoco/Ticapsoriginal_selenium_sitemaps_driver.git
  • Change the sitemapsdriver.py file with your sitemap url

run Selenium sitemaps driver:

python sitemapsdriver.py

quality:

about: