Skip to content
This repository has been archived by the owner on May 3, 2021. It is now read-only.
/ ScraperBot Public archive

A bot to get product description, product sizes, product price

Notifications You must be signed in to change notification settings

kevinrvaz/ScraperBot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ScraperBot

A bot to get product description, product sizes, product price

Installation

  • run virtualenv -p python3.6 venv to create a virtual environment
  • activate the virtual environment using source venv/bin/activate
  • run pip install -r requirements.txt to install all dependencies

Usage

  • run the program using python scraperbot.py

  • after running the program you will see a data.csv has been generated it contains the following data in the respective order

    data.csv contents:-

    • product title (string)
    • product description (string)
    • product price (string)
    • product colors (array)
    • product image url (string)
    • product sizes (array)

Other Requirements

  • To enable the proxy feature you need to ensure that you are running tor on you local computer, to download tor browser visit https://www.torproject.org/download/, once downloaded start the browser and set proxy=True while calling bot.start()

About

A bot to get product description, product sizes, product price

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages