Page content stream (size limits) with Playwright

[j4r3kb]

Hi. Does Crawlee in combination with Playwright support fetching the page content in chunks (stream) so it is possible to control the total size of the page?
Not all pages return the Content-Lenght header so I would like to stop fetching the page if the content surpasses the given limit.

[janbuchar]

Hi @j4r3kb and thanks for your interest in Crawlee! I believe we don't do any extra steps to make this possible. Can you achieve this behavior with Playwright alone? If yes, I'll check if we can work a solution out 🙂