Skip to content

Full-stack Scraper for Mozilla News adding React front end, Mongoose/MongoDB on Node.js/Express back end

Notifications You must be signed in to change notification settings

cslin82/mongo-react-news-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Mongo News Scraper with React

Task

This full-stack single-page news app adds a React front end to the previous Mongo News Scraper. It continues to use Express, Node.js, Mongoose/MongoDB, and cheerio to allow users to save/unsave and comment on posts from the Mozilla Blog. It also introduces conversion of a server-rendered app to a React app.

Concepts and technologies

  • New: React, React Router, controlled forms
  • New: RESTful API creation
  • Mongoose and MongoDB
  • Scraping server-side using cheerio
  • Express.js running on Node.js
  • Writing APIs and calls from frontend
  • NPM for JS library management
  • Custom Node.js modules and modular design, spreading logic and data across multiple files
  • Deploying full MERN stack apps to Heroku

Enhancements

  • Add UI for scraping deeper
  • Incorporate data validation
  • Write mocha/chai tests

TODO

  • Write help page
  • Clean up code and logic
  • Consolidate methods
  • Make deletes also delete ref in article model
  • Use return data from API AJAX calls
  • Convert scrape request to axios

About

Full-stack Scraper for Mozilla News adding React front end, Mongoose/MongoDB on Node.js/Express back end

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published