Table of Contents
WebCountry is a desktop/mobile friendly app utilizing React and Express that enables users to track product info from Backcountry.com. Using the Puppeteer library, the application scrapes the page for up-to-date information every 12 hours as a background service. The user may visualize the changes over time in a line graph if enough data is collected.
Instructions to setup WebCountry on your local machine below.
npm install npm@latest -g
- Clone the repo
git clone https://github.com/stevkim/scraper/
- Install NPM packages
npm install
- Enter your ENV varaibles into a
.env
fileDB = (your database name) USERNAME = (your database user) PASSWORD = (your database password) HOST = (your database host)
- Run build command.
npm run build
- Run in production environment
npm run start
WebCountry is run on the designated port and opens a webpage as soon as the npm start command is utilized. It can also be accessed utilizing localhost:3000 directly in the browser.
- Designing the App
- Build the Backend & the Scraping service
- Build the Frontend & integrate with the Backend
- Refactor and optimize code
- Deploy on AWS