Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle it gracefully when start_url is used instead of start_urls #4133

Closed
Gallaecio opened this issue Nov 6, 2019 · 1 comment · Fixed by #4170
Closed

Handle it gracefully when start_url is used instead of start_urls #4133

Gallaecio opened this issue Nov 6, 2019 · 1 comment · Fixed by #4170

Comments

@Gallaecio
Copy link
Member

Over the last year I’ve seen a few cases (recent example) of this, people missing the s at the end of the start_urls.

It may be nice to find a way to gracefully let the developer know where the issue is, why there is no crawling happening.

@Gallaecio Gallaecio changed the title Handle it gracefully when start_url is used instead of start_urls Handle it gracefully when start_url is used instead of start_urls Nov 6, 2019
@Kunal614
Copy link

As in the scrappy many files are autogenerated when you start a new project and there start_urls is already declared by default , so if we use start_url instead of start_urls then there would be no crawling.

mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 18, 2019
…'start_urls' and 'start_url' found. Added test.
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 18, 2019
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 20, 2019
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 20, 2019
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 20, 2019
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 20, 2019
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 20, 2019
mabelvj added a commit to mabelvj/scrapy that referenced this issue Nov 21, 2019
…'start_urls' and 'start_url' found. Added test.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants