Portwest Products Scraper

Extracts all products on portwest.co.uk site into a csv file

Installation

Without Docker:

git clone https://github.com/ztobs/portwest-scraper-js.git
cd portwest-scraper-js
nano pw_credentials.json
{
  "email": "xxx",
  "password": "xxxxxxxxx"
}
npm install
npm run scrap

With Docker:

git clone https://github.com/ztobs/portwest-scraper-js.git
cd portwest-scraper-js
nano pw_credentials.json
{
  "email": "xxx",
  "password": "xxxxxxxxx"
}
docker build -t pwscraper .
docker run -it pwscraper
cd ~/portwest-scraper-js
npm run scrap

Usage

• You obviously need git installed on your machine
• for running with docker, you dont need npm installed on your machine
• pay attention to the part where you have to create the pw_credential.json file and add your login credentils
• the exported files will be in the generated/ folder

Release History

• 0.0.1
  • Work in progress

Meta

Joseph Lukan – @dadonztobs – ztobscieng@gmail.com

https://github.com/ztobs/portwest-scraper-js

Contributing

1. Fork it (https://github.com/ztobs/portwest-scraper-js/fork)
2. Create your feature branch (git checkout -b feature/fooBar)
3. Commit your changes (git commit -am 'Add some fooBar')
4. Push to the branch (git push origin feature/fooBar)
5. Create a new Pull Request