Skip to content

epleaner/scrape-your-music

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrapeyourmusic

A python-based web scraper for www.rateyourmusic.com, powered by scrapy.

How to use

Navigate to the outer scrapeyourmusic directory, and:

scrapy crawl album_scraper

Scraped data will appear in out/ by default, in json format.

To override output file or export format:

scrapy crawl album_scraper -o myOutput myFormat,

where available feed formats can be found here:

http://doc.scrapy.org/en/latest/topics/feed-exports.html#topics-feed-format

Keep in mind that scrapy does not overwrite the output file on consecutive crawls, and scraped data will instead be appended to the output file.

About

A python-based web scraper for www.rateyourmusic.com, powered by scrapy

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages