Skip to content

hcikim/WebCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Amazon Product Review Crawler

URL: https://www.amazon.com/

Amazon.com is an online social media which is focused on online shopping mall. Amazon customers are allowed to leave their comments for any products they purchased. To utilize the review data for information retrieval or else, you can utilize this review data crawler.

COLOURlover Favourite Color Theme Crawler

URL: http://www.colourlovers.com/

COLOURlover is an online crowdsourcing platform which lets random online users share anything about colours or artistic works. Although COLOURlover API is publicly available, it does not provide the exact data form which I needed for my research, here I built myself the data crawler.

Open Spotify Crawler

URL: https://open.spotify.com/

Spotify is one of the most popular music websites. This webcrawler collects titles and artists of a given playlists. To utilize this crawler, you need to specify a list of URLs which you wish to crawl.

All crawler in this repository is only for academic research purposes.

© 2019 Taewook Kim ALL RIGHTS RESERVED

About

Web Crawlers for Research Purposes

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages