Skip to content

A web scrapping homework assignment that gets html data from specified websites.

License

Notifications You must be signed in to change notification settings

JasonRobnson/webScrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

47 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ProPublica Scrapper Build Status npm PRs Welcome GitHub license

This app uses Axios a browser based HTTP client to access content upon ProPublica's webpage. This content is then manipulated and displayed to the user.

Problem solved

  1. How to access different content across a variety of sites without actually having to physically visit each site.
  2. How to store data without creating redundant enteries.
  3. How do we allow the user to attach comments/likes to data.

Deployed Site

alt text Deployed App

Tools

  • Node.js
  • Mysql
  • Express.js
  • JQUERY
  • HandleBars.js
  • Heroku
  • GitHub
  • Nodemon.js
  • DocToc (Table of Contents)
  • Materialize
  • MongoDb
  • Mongoose.js
  • Morgan
  • Cherrio
  • Axios

Table of Contents generated with DocToc

Required File Structure

alt text

commands

  • nodemon server.js || node server.js: will get the app up and running after all dependencies are installed.

Database

MongoDB is used as the database for this project.

About

A web scrapping homework assignment that gets html data from specified websites.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published