Use a spider to crawl the test website

[webtechpooja]

The step to use a spider to crawl the test website, was seen within the list of things to do for release testing. The specific way to do it was not linked at that point, and hence, I thought this might help.

Google doc link- https://docs.google.com/document/d/1x2truDi9Ml9d7LedUVPgP_w_RqhtfTTE8fxn1ItyWO8/edit?usp=sharing

[webtechpooja]

This issue was discussed in the slack thread, this is link for reference - https://wordpress.slack.com/archives/C03B0H5J0/p1710242755542039

[nagpai]

I have made some updates, including adding details of using wget2 in the Google doc linked above.

[martinkrcho]

Thanks for the updates @nagpai. wget2 and default theme data for import sound very reasonable.

The document looks like a good starting point. Let's publish it and make updates once there's some feedback from the community.

[kjnanda]

This would be really helpful if we get the visual explanation on how to use this! 🙇🏻‍♀️

[webtechpooja]

It is now in the handbook: https://make.wordpress.org/test/handbook/get-setup-for-testing/crawl-your-test-site-for-errors/