2.11.1

• Security bug fixes.
• Support for Twisted >= 23.8.0.
• Documentation improvements.

See the full changelog.

1.8.4

Security bug fixes.

See the full changelog.

2.11.0

• Spiders can now modify settings in their from_crawler methods, e.g. based on spider arguments.
• Periodic logging of stats.
• Bug fixes.

See the full changelog.

2.10.1

Marked Twisted >= 23.8.0 as unsupported.

2.10.0

• Added Python 3.12 support, dropped Python 3.7 support.
• The new add-ons framework simplifies configuring 3rd-party components that support it.
• Exceptions to retry can now be configured.
• Many fixes and improvements for feed exports.

See the full changelog.

2.9.0

• Per-domain download settings.
• Compatibility with new cryptography and new parsel.
• JMESPath selectors from the new parsel.
• Bug fixes.

See the full changelog.

2.8.0

This is a maintenance release, with minor features, bug fixes, and cleanups.

See the full changelog.

2.7.1

• Relaxed the restriction introduced in 2.6.2 so that the Proxy-Authentication header can again be set explicitly in certain cases, restoring compatibility with scrapy-zyte-smartproxy 2.1.0 and older
• Bug fixes

See the full changelog

2.7.0

• Added Python 3.11 support, dropped Python 3.6 support
• Improved support for asynchronous callbacks
• Asyncio support is enabled by default on new projects
• Output names of item fields can now be arbitrary strings
• Centralized request fingerprinting configuration is now possible

See the full changelog

2.6.3

Makes pip install Scrapy work again.

It required making changes to support pyOpenSSL 22.1.0. We had to drop support for SSLv3 as a result.

We also upgraded the minimum versions of some dependencies.

See the changelog.