-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Command Shell Error, Read URLs from Redis #50
Comments
When commenting The above note about the debug "Reading URLs from redis list" don't make difference, it is still present when The question is, how your Thank you |
Scrapy 1.1.0 is finally released in pypi... would be awesome if scrapy-redis support py3 and scrapy 1.1.0 |
The problem is happening When the engine calls I'm using the
the method
I have added 3 prints into
Running the
The previous error: happens when
I don't know yet what is wrong |
Latest release support Python 3.x. Besides that, it's a scrapy limitation to require callbacks to me spider methods. However, I have added a TODO to avoid serializing those requests. |
Any updates? It's still an issue in 2018. :/ |
@Congee a workaround is to open the shell first (i.e.: |
@rmax Yeah, that's a workaround. Thanks anyway. |
Hello,
When executing a
scrapy shell
into an URL it loads Redis List, as you can see in the output:https://paste.ee/r/PPkg2
Attention to:
2016-04-26 02:14:01 [epocacosmeticos.com.br] -> DEBUG: Reading URLs from redis list 'epocacosmeticos.com.br:start_urls'
prior to error.Before install scrapy-redis,
scrapy shell
was working ok.Scrapy 1.1.0rc3
andPython 3.5.1
Thank you
The text was updated successfully, but these errors were encountered: