Replies: 2 comments 1 reply
|
@tinamrak Hi, at least in my theme, the facets are not links to crawl. So, if the bot crawls it, it's just a stupid bot. And for this reason, we have implemented a block that blocks these pages from indexation - #37066. |
1 reply
|
Hello, That's right, each faceted search element generates thousands of URLs, which has significant consequences for e-commerce sites, for example. Many bots, including Google and other AI bots, overwhelm servers with hundreds of thousands of requests. I agree with the suggested options:
How can we ensure that ps-faceted-search natively includes settings within the module to manage this manually without having to modify the code or develop custom fixes? Another solution was also provided for this ticket : #40335 |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I published a real-world case study about
ps_facetedsearchcreating a crawl trap in PrestaShop.A store with around 2,000 real pages ended up exposing hundreds of thousands of faceted URLs because filter combinations were rendered as normal crawlable links.
This caused bot crawling, Plesk / Fail2Ban blocking CDN IPs, Googlebot receiving 500 errors, and eventually deindexing of real URLs.
I think the module needs a built-in option to render filters as non-crawlable controls while keeping AJAX filtering for users.
Suggested options:
data-search-urlBlog post with details and workaround:
PrestaShop faceted search creating thousands of URLs, Plesk blocking Bunny CDN IPs, and Google deindexing pages
Related issue:
#34415
All reactions