Skip to content

Configured a scrapy project-- scraped amazon's "Best Sellers" webpage. Crawled and extracted the names and prices for the top 50 items on that page. Transformed the data into a .csv file. Lightweight pipeline and middleware configuration based on spider needs.

Notifications You must be signed in to change notification settings

amichellemosley/Scrapy-Project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

ETL-DataEngineering-Project-With-Amazon

Configured a scrapy project, scraped amazon's best seller webpage. Crawled and extracted the names & prices for the top 50 items on that page. Transformed the data into a .csv file. Results stored in the spider folder of the project (amazonelectronicsinfo.csv). Lightweight pipeline and middleware configuration based on spider needs. sample spider image

About

Configured a scrapy project-- scraped amazon's "Best Sellers" webpage. Crawled and extracted the names and prices for the top 50 items on that page. Transformed the data into a .csv file. Lightweight pipeline and middleware configuration based on spider needs.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages