You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This leads to a few hour of head scratching figuring out why it was disabled. A better error log would be along the lines of: Disabled feed storage scheme: s3. Reason: missing botocore library
Steps to Reproduce:
Open a new shell without botocore installed/declared in it
There's this log message that was popping up when we intended to export data via S3:
Disabled feed storage scheme: s3.
The problem was that the existing code is catching the
NotConfigured
exceptions:https://github.com/scrapy/scrapy/blob/master/scrapy/extensions/feedexport.py#L272
This occurs when either of botocore or boto libs aren't installed and the user is attempting to export via S3 (set via
FEED_URI
scheme): https://github.com/scrapy/scrapy/blob/master/scrapy/utils/boto.py#L19This leads to a few hour of head scratching figuring out why it was disabled. A better error log would be along the lines of:
Disabled feed storage scheme: s3. Reason: missing botocore library
Steps to Reproduce:
botocore
installed/declared in itscrapy shell -s FEED_URI='s3://test.com'
The text was updated successfully, but these errors were encountered: