save page elements like scripts, assets, images, styles with html offline

[mllife]

given a url i want to save the html page but also its related content, so it can be loaded fully offline; how can i do it ? any resources or it is not supported ?

[janbuchar]

Hello, for this usecase, I would recommend something like monolith - https://github.com/Y2Z/monolith

[mllife]

@janbuchar , this is intresting but I also have usecases where I want to store the page after javascript rendering and scroll till end, and sometimes certain click actions as well. Anyway this can be integrated with playwright?

[Mantisus]

@janbuchar , this is intresting but I also have usecases where I want to store the page after javascript rendering and scroll till end, and sometimes certain click actions as well. Anyway this can be integrated with playwright?

Look at route - https://playwright.dev/python/docs/api/class-route, to save elements that are loaded at runtime (images, js and such). But you will also have to update the HTML page before saving to specify a new path to the loaded elements.

[janbuchar]

@mllife you can definitely call monolith via subprocess from just about everywhere. Then you probably wouldn't need to use PlaywrightCrawler. But that's all very hypothetical, if you need precise control, what @Mantisus suggests will work best.