Skip to content

Troubleshooting

Alexandr Krikun edited this page Oct 26, 2026 · 1 revision

Troubleshooting

"may block CSS/JS that search engines need"

Google renders pages and needs your stylesheets and scripts. Remove that Disallow, or add Allow rules for the CSS/JS files.

My rules are not applied to a specific bot

A crawler that has its own group ignores the * group. Add the rule to that group (via extraGroups in the config) as well.

Verify the result

Check the deployed file and test URLs against it with the companion robots-checker.

Still stuck?

Open an issue with the command, the output (--json if possible) and your Node.js version — or compare with the online version.

Clone this wiki locally