Scrapy response.flags are really useful and underappreciated feature. It would be useful to add a way to pass flags argument to Request at initialization, e.g.
This is useful because it allows you to have some heplful debugging metadata directly in logs. If you want to debug some spider problem you will have some metadata directly in logs and you dont have to start debugger in some callback and investigate response meta or some other stuff.
The text was updated successfully, but these errors were encountered:
pawelmhm
changed the title
add extra flags kwarg to Request class
add "flags" kwarg to Scrapy Request
Jun 10, 2016
Scrapy response.flags are really useful and underappreciated feature. It would be useful to add a way to pass flags argument to Request at initialization, e.g.
and then in log output you will have:
This is useful because it allows you to have some heplful debugging metadata directly in logs. If you want to debug some spider problem you will have some metadata directly in logs and you dont have to start debugger in some callback and investigate response meta or some other stuff.
The text was updated successfully, but these errors were encountered: