Skip to content

Amazon review scraper - download as CSV with auto saving and full pagination

Notifications You must be signed in to change notification settings

ryanckulp/amz_reviews

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 

Repository files navigation

Amazon Review Scraper

download a CSV of up to 5,000 reviews for any Amazon product. video tutorial for non dorks is here.

video demo

90 second tutorial: https://youtu.be/p_z-nmyTU7Y?si=Psk3xz_xGl_rmcB_

installation

first install Ruby. then ensure the following Ruby gems are installed (gem install <gem_name>):

  • watir
  • headless

next (optional), move the amz_reviews file (from this repo) to an executable path. for Mac users this is often:

mv amz_reviews /usr/local/bin

note: this scraper uses Firefox by default. to switch to Chrome, replace :firefox with :chrome in the code but be forewarned - you may run into headaches. KISS.

using the scraper

simply: amz_reviews <asin> <page_start> <page_end>

(if you did not move the amz_reviews code to an executable path, run it via ./amz_reviews <asin> <page_start> <page_end> from the directory in which you saved it)

scraper parameters

  • asin is Amazon's product identifier, which you can grab from any product page
  • page_start and page_end are optional; Amazon returns up to 500 pages, or 5,000 reviews

output

your terminal will produce a live log of scraping progress, which autosaves every 50 reviews. the finished result will be a CSV report inside the directory from which you ran the scraper.

sample report from asin "B07C7FS86W"

image

About

Amazon review scraper - download as CSV with auto saving and full pagination

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages