Document CrawlSpider.parse_start_urls method #321

Merged
merged 1 commit into from Jun 10, 2013

Projects

None yet

2 participants

@barraponto
Contributor

The parse_start_urls method is very useful when you want to scrape paged lists, since you'd need to parse the first page as well as the next ones (which usually get a callback from the Rules). It should make it easier for people asking this very question: http://stackoverflow.com/questions/15836062/scrapy-crawlspider-doesnt-crawl-the-first-landing-page

@dangra dangra merged commit 1e1b161 into scrapy:master Jun 10, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment