Skip to content

rmglennon/web-scraping-mongodb

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scrape news headlines into MongoDB

This is a full-stack JavaScript app built using MongoDB, Mongoose, Node.js, Express.js, Handlebars.js, HTML, and CSS. It scrapes the TechCrunch homepage and stores article titles and links, along with your notes and favorites, in MongoDB. The articles and notes collections reference each other through population.

https://mongo-tech-news-scraper.herokuapp.com/

screenshot of the homepage

Get new articles, save favorites, and write notes

To see updated news stories, click Get new articles at the top of the Home page. To view the full article, click the View article on TechCrunch link.

When you see an article in the list that you want to mark as a favorite, click Save article, and read it again by clicking Saved articles in the top menu bar. After you have an article in your saved list, you can comment on it by clicking Add note.

Add notes to a page

Note: There is no login system, so all saved articles and comments are visible to and can be deleted by all users.

Local set up for development purposes

These must be installed to run the app locally:

You first need to make a local MongoDB database named news. Then, in a terminal window, navigate into the folder where you downloaded this app and type npm install. To start the app, type node server.js and open your browser to localhost:3000.

Technology

About

News web scraper that stores links, notes, and favorites in MongoDB

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published