New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add metadata to URLs to retrieve from Redis #287

Closed

tteguayco opened this issue Nov 30, 2023 · 2 comments

Labels

tteguayco commented Nov 30, 2023

Can metadata about a URL be added to the Redis queue so that it is available to the Scrapy spider that reads such URL?

Owner

rmax commented Nov 30, 2023

See this thread #203 (comment)

With make_request_from_data you can load your custom data from redis

rmax added the question label

Author

tteguayco commented Nov 30, 2023

Nice. Thank you, @rmax!

tteguayco closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment