What's the bot useragent to autorise in my robots.txt ? #18310
-
I acutally want to know what's the useragent of the bot who validate the rel="me" on the website to green the link on our website ? I ask because i do not want to be indexed by search engine and the only 2 remaining possibility of the bug it's the robots.txt (and robot header) the bot don't come. Or the country from where the bot operate (but must be the same of the instance). Thanks ! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
I have found the problem post it for other, |
Beta Was this translation helpful? Give feedback.
I have found the problem post it for other,
Actually i used a modern config of nginx, witch only allow tls 1.3, it seem the script (or bot) who check Rel me use TLS 1.2, so the https connection fail and the check fail too.