Skip to content

@wRAR wRAR released this Apr 6, 2021

  • Official Python 3.9 support
  • Experimental HTTP/2 support
  • New get_retry_request() function to retry requests from spider callbacks
  • New headers_received signal that allows stopping downloads early
  • New Response.protocol attribute

See the full changelog

Assets 2

@Gallaecio Gallaecio released this Nov 17, 2020

  • Fixed feed exports overwrite support

  • Fixed the asyncio event loop handling, which could make code hang

  • Fixed the IPv6-capable DNS resolver CachingHostnameResolver for download handlers that call reactor.resolve

  • Fixed the output of the genspider command showing placeholders instead of the import part of the generated spider module (issue 4874)

Assets 2

@Gallaecio Gallaecio released this Oct 11, 2020

Hihglights:

  • Python 3.5 support has been dropped.

  • The file_path method of media pipelines can now access the source item.

    This allows you to set a download file path based on item data.

  • The new item_export_kwargs key of the FEEDS setting allows to define keyword parameters to pass to item exporter classes.

  • You can now choose whether feed exports overwrite or append to the output file.

    For example, when using the crawl or runspider commands, you can use the -O option instead of -o to overwrite the output file.

  • Zstd-compressed responses are now supported if zstandard is installed.

  • In settings, where the import path of a class is required, it is now possible to pass a class object instead.

See the full changelog

Assets 2

@Gallaecio Gallaecio released this Aug 4, 2020

Hihglights:

See the full changelog

Assets 2

@Gallaecio Gallaecio released this Jul 17, 2020

The startproject command no longer makes unintended changes to the permissions of files in the destination folder, such as removing execution permissions.

Assets 2

@Gallaecio Gallaecio released this Jun 24, 2020

Highlights:

See the full changelog

Assets 2

@Gallaecio Gallaecio released this Apr 24, 2020

Highlights:

See the full changelog

Assets 2

@Gallaecio Gallaecio released this Mar 18, 2020

  • Response.follow_all now supports an empty URL iterable as input (#4408, #4420)
  • Removed top-level reactor imports to prevent errors about the wrong Twisted reactor being installed when setting a different Twisted reactor using TWISTED_REACTOR (#4401, #4406)
Assets 2

@Gallaecio Gallaecio released this Mar 3, 2020

Highlights:

  • Python 2 support has been removed
  • Partial coroutine syntax support and experimental asyncio support
  • New Response.follow_all method
  • FTP support for media pipelines
  • New Response.certificate attribute
  • IPv6 support through DNS_RESOLVER

See the full changelog

Assets 2
Oct 29, 2019
Bump version: 1.7.0 → 1.8.0