Skip to content

RAM usage question #209

@andrei-volkau

Description

@andrei-volkau

I have one question about RAM usage.

Screenshot 2023-07-16 at 15 36 37

My scrapy code is not executing anymore, but I am still able to see that RAM is being consumed by playwright.
What should I do to avoid all RAM to be consumed by paywirght even so that scraping process is not running any more? Should I find and kill playwright processes on Spider closed event?

I was having a lot of playwright timeouts during scraping. Maybe I experienced memory leaks?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions