Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cannot crawl, cannot walk, cannot run #13

Closed
ErezBinyamin opened this issue Jun 21, 2018 · 1 comment
Closed

cannot crawl, cannot walk, cannot run #13

ErezBinyamin opened this issue Jun 21, 2018 · 1 comment

Comments

@ErezBinyamin
Copy link

I'm working on a side project with some friends and I stumbled across your scrapy repo. It looks really cool and exactly what I need to scrape the web for a bunch of firmware! I'm unfamiliar with the scrapy package, and your readme's recommendation of:

scrapy crawl dlink

has yielded nothing but errors and hanging for me. I'm still reading though scrapy docs and your code, but I'm struggling to get any of the spiders to crawl. I was hoping you might be able to give me some guidance on how to go about using your tool. If there are any config files, scrapy command line options, unlisted dependencies, or other things I might be missing, a bit of direction on how to start web-crawling would help me a lot.

scarpyerror

Regardless, thank you for all your work on what looks like an amazing open source tool!

@ddcc
Copy link
Collaborator

ddcc commented Jun 21, 2018

Seems to be duplicate of #7. You need to upgrade to newer version of scrapy.

@ddcc ddcc closed this as completed Jun 21, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants