Document CrawlSpider.parse_start_urls method #321

merged 1 commit into from Jun 10, 2013


None yet

2 participants


The parse_start_urls method is very useful when you want to scrape paged lists, since you'd need to parse the first page as well as the next ones (which usually get a callback from the Rules). It should make it easier for people asking this very question:

@dangra dangra merged commit 1e1b161 into scrapy:master Jun 10, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment