scrapy-playwright changelog

v0.0.34 (2024-01-01)

Update dev status classifier to 4 - beta
Official Python 3.12 support (#254)
Custom memusage extension (#257)

v0.0.33 (2023-10-19)

Handle downloads as binary responses (#228)

v0.0.32 (2023-09-04)

Connect to browser using CDP (#227)

v0.0.31 (2023-08-28)

Do not fail when getting referer header for debug log messages (#225)
Do not override headers with values from asset requests (#226)

v0.0.30 (2023-08-17)

Fix page_init_callback duplication (#222)
Bump minimum Python version from 3.7 to 3.8 (#223)

v0.0.29 (2023-08-11)

Set exc_info=True for warning log records (#219)
Invoke page_init_callback after setting route (#205)

v0.0.28 (2023-08-05)

Retry page.content if necessary (#218)

v0.0.27 (2023-07-24)

Override method only for navigation requests (#177)
Pass spider argument to _create_browser_context (#212)
await AsyncPlaywright.stop on close (#214)

v0.0.26 (2023-02-01)

Fix logging (pass extra args instead of updating log record factory)
Miscellaneous adjustments (naming, typing, etc)

v0.0.25 (2023-01-24)

Set spider attribute on log records

v0.0.24 (2022-12-04)

Fix request method override

v0.0.23 (2022-11-27)

Set redirect request metadata

v0.0.22 (2022-10-09)

Remove deprecated code (PageCoroutine class, playwright_page_coroutines request meta key, use_playwright_headers function).
playwright_page_init_callback meta key (page initialization callback)

v0.0.21 (2022-08-08)

Fixed TypeError exception when getting server IP address

v0.0.20 (2022-08-03)

Don't raise exceptions if Page.goto returns None

v0.0.19 (2022-07-17)

Add support for Page.goto keyword arguments (playwright_page_goto_kwargs request meta key)

v0.0.18 (2022-06-18)

Always override request headers

v0.0.17 (2022-05-22)

Support for persistent contexts
Limit concurrent context count (PLAYWRIGHT_MAX_CONTEXTS setting)

v0.0.16 (2022-05-14)

Use new headers API introduced in Playwright 1.15 (bump required Playwright version)
Deprecate scrapy_playwright.headers.use_playwright_headers, set PLAYWRIGHT_PROCESS_REQUEST_HEADERS=None instead

v0.0.15 (2022-05-08)

Remove deprecated PLAYWRIGHT_CONTEXT_ARGS setting
Warn on failed requests
PLAYWRIGHT_ABORT_REQUEST setting: accept coroutine functions
PLAYWRIGHT_PROCESS_REQUEST_HEADERS setting: accept sync functions to process headers
Set playwright_page request meta key early

v0.0.14 (2022-03-26)

Renamed scrapy_playwright.page.PageCoroutine to scrapy_playwright.page.PageMethod (PageCoroutine is now deprecated). Also deprecated the playwright_page_coroutines Request meta key in favor of playwright_page_methods.

v0.0.13 (2022-03-24)

PageCoroutine checks
Fix encoding detection
Ability to abort requests via setting

v0.0.12 (2022-03-15)

Avoid exceptions during cleanup when the browser could not start
Warn when non PageCoroutine objects are passed to Request.meta.playwright_page_coroutines

v0.0.11 (2022-03-12)

Set the maximum amount of pages per context
Response.ip_address attribute
Response security details

v0.0.10 (2022-03-02)

Fix response encoding detection

v0.0.9 (2022-01-27)

Ability to process request headers

v0.0.8 (2022-01-13)

Fix PLAYWRIGHT_DEFAULT_NAVIGATION_TIMEOUT setting (allow zero value)

v0.0.7 (2021-10-20)

Log all requests/responses (debug level)

v0.0.6 (2021-10-19)

Page event handlers
Python 3.10 support
Doc fixes
Override User-Agent header

v0.0.5 (2021-08-20)

Improve garbage collection by removing unnecessary reference

v0.0.4 (2021-07-16)

Add support for multiple browser contexts (#13)
Deprecate PLAYWRIGHT_CONTEXT_ARGS setting in favor of PLAYWRIGHT_CONTEXTS

v0.0.3 (2021-02-22)

Snake case (requires playwright-python >= v1.8.0a1)

v0.0.2 (2021-01-13)

PLAYWRIGHT_CONTEXT_ARGS setting (ability to pass keyword arguments to the browser context)

v0.0.1 (2020-12-18)

Initial public release.