Skip to content

Website that scrapes Google for item reviews and runs sentiment analysis

Notifications You must be signed in to change notification settings

henrlly/ReviewScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Review Scraper

Website that scrapes Google for reviews of an item (product, movie, etc.) and runs sentiment analysis on result descriptions

LIVE at reviewscrper.streamlit.app!

TIP: Be specific e.g. PS5 console not PS5

What it uses

  • Huggingface for sentiment analysis
    • Uses LiYuan/amazon-review-sentiment-analysis for 1-5 star rating
    • Uses cardiffnlp/twitter-roberta-base-sentiment-latest for positive/neutral/negative sentiment
  • Apify for scraping Google
  • Streamlit for hosting the website
  • WordCloud for word clouds

Demo

screencapture-of-website

How to host locally

  1. Install requirements
pip install -r requirements.txt
  1. Make an account on Apify
  2. Create the file /.streamlit/secrets.toml with the contents:
APIFY_TOKEN='YOUR_API_TOKEN'
  1. Run main.py
streamlit run main.py

References

About

Website that scrapes Google for item reviews and runs sentiment analysis

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages