Skip to content

Web-scraping application, built using React, Redux, React Router for the frontend. Backend is built with Node.js, Express.js, MongoDB

Notifications You must be signed in to change notification settings

stevkim/webcountry

Repository files navigation

WebCountry

Table of Contents
  1. About
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Contact

About

WebCountry is a desktop/mobile friendly app utilizing React and Express that enables users to track product info from Backcountry.com. Using the Puppeteer library, the application scrapes the page for up-to-date information every 12 hours as a background service. The user may visualize the changes over time in a line graph if enough data is collected.

Built With

node.js React Redux React-Router Express MongoDB

Getting Started

Instructions to setup WebCountry on your local machine below.

Prerequisites

NPM

npm install npm@latest -g 

Installation

  1. Clone the repo
    git clone https://github.com/stevkim/scraper/
  2. Install NPM packages
    npm install
  3. Enter your ENV varaibles into a .env file
     DB = (your database name)
     USERNAME = (your database user)
     PASSWORD = (your database password)
     HOST = (your database host)
  4. Run build command.
    npm run build
  5. Run in production environment
    npm run start

Usage

WebCountry is run on the designated port and opens a webpage as soon as the npm start command is utilized. It can also be accessed utilizing localhost:3000 directly in the browser.

back to top

Roadmap

  • Designing the App
  • Build the Backend & the Scraping service
  • Build the Frontend & integrate with the Backend
  • Refactor and optimize code
  • Deploy on AWS

Contact

Steven Kim Linkedin | GitHub

back to top

About

Web-scraping application, built using React, Redux, React Router for the frontend. Backend is built with Node.js, Express.js, MongoDB

Topics

Resources

Stars

Watchers

Forks