Google page crawler problems

[Humbi1992]

Good Morning

We use your plugin to detect if a user visits our page with the Internet Explorer Browser.
To check this we do following Check:

{% if craft.agent.check('ie') and not craft.agent.isRobot() %}
{% include '_partials/not-supported.twig' %}
{% else %}
{% include '_partials/navigation.twig' %}
{% block body %}
{% endblock %}
{% include '_partials/footer.twig' %}
{% endif %}

This works fine for the Internet Explorer detection, but the Google Page Crawler get's into this If clause too. So the page is not indexed by Google.

How can we fix this problem?
Please let me know if you need further details.

Kind regard

[marknotton]

Thanks for reporting this @Humbi1992

Many of the methods in this Agent plugin are just wrappers to jenssegers/agent tool. Further up the chain, their 'isRobot' method refers to JayBizzle/Crawler-Detect .

This Agent plugin requires the latest stable version of jenssegers/agent. If you're in a position to run a composer update you may find this could have already been patched 🤞

You can check if each of your installed packages are up-to date using these commands:

composer show jenssegers/agent Latest: v2.6.3
composer show jaybizzle/crawler-detect Latest: v1.2.95

I'm going to see if I can replicate your circumstance though, as the Google Page Crawler seems like an obvious thing "Crawler-Detect" should be able to detect.

As it stands... this is just a long-winded way of me saying I'm probably not going to be able to help. Sorry. You may need to raise an issue with Crawler-Detect instead to include the "Google Page Crawler" User Agent in their database. It may have been updated by Google.

Obviously if I'm misunderstanding something please let me know. Happy to look into it.

[marknotton]

Hi @Humbi1992, you can now add User Agent exceptions to resolve the problem you were having. The query for 'ie' and it returning 'true' when it shouldn't have was related to the same bug. All fixed now.