📰 A Google News scraper and slim server to analyze the sentiment of our news. Flask + Mongo.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
sentiment_scraper
server
.gitignore
LICENSE
README.md
install.sh
requirements.txt
run.py

README.md

News Sentiment

A Google News scraper and slim server to analyze the sentiment of our news.
For HST 325, Visualizing Society.
Yet another project with Flask and Mongo.

A visualization of the scraped data lives here!

Running

Keys

Keys are in bash scripts that simply export them to the environment.
They are loaded through the install.sh script.

  • Need a Facebook application access token for interacting with the Graph API
  • Need a Mashape Key to analyze Sentiment
  • Need an AWS Key + Secret, and a bucket named news-sentiment, for storing the article text outside of Mongo
  • To run in production mode: need a secret key for the Flask Server, stored in a .txt file

File structure should look like:

sentiment_scraper/
server/
    secret-key.private.txt
    ...
install.sh
...
aws-account.private.sh
facebook-access-token.private.sh
mashape-key.private.sh
...

To install and load:

source ./install.sh

Run.py

Running options:

python run.py --help