Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handling of AMP Access pages by robots #1936

Closed
jugglingcats opened this issue Feb 11, 2016 · 3 comments
Closed

Handling of AMP Access pages by robots #1936

jugglingcats opened this issue Feb 11, 2016 · 3 comments

Comments

@jugglingcats
Copy link

It would be good to understand if there is expected to be any special handling of AMP Access enabled pages by robots. For example, are robots expected to call the authorization and pingback urls and evaluate AMP Access expressions, only indexing visible parts of the content? If so, should robots send their regular user-agent strings to these endpoints?

Any special considerations for server mode support and robots?

@cramforce
Copy link
Member

Note that the AMP cache robots.txt blocks direct robots access (with a
documented rule how to treat cache URLs like origin URLs). That basically
reduces the problem to how you want to handle robots on your own site.

On Thu, Feb 11, 2016 at 2:05 AM, jugglingcats notifications@github.com
wrote:

It would be good to understand if there is expected to be any special
handling of AMP Access enabled pages by robots. For example, are robots
expected to call the authorization and pingback urls and evaluate AMP
Access expressions, only indexing visible parts of the content? If so,
should robots send their regular user-agent strings to these endpoints?

Any special considerations for server mode support and robots?


Reply to this email directly or view it on GitHub
#1936.

@jugglingcats
Copy link
Author

I think that makes sense. Are you saying that search engines will always index the canonical URL, but may then send the user to the amp version of the page using the link information, eg. link rel="amphtml" href="/path/to/amp.html".

Apologies if this is obvious and already discussed at length. I read #498 and #1905 which provided some further insight.

Thanks

@rudygalfi rudygalfi added this to the M1 milestone Feb 13, 2016
@rudygalfi rudygalfi modified the milestones: M1, Up Next Mar 4, 2016
@adelinamart
Copy link
Contributor

Hey,

The AMP community has been working nonstop to make AMP better, but somehow we've still managed to grow an enormous backlog of open issues. This has made it difficult for the community to prioritize what we should work on next.

A new process is on the way and to give it a chance for success we will be closing issues that have not been updated in awhile.

If this issue still requires further attention, simply reopen it. Please try to reproduce it with the latest version to ensure it gets proper attention!

We really appreciate the contribution! Thank you for bearing with us as we drag ourselves out of the issue abyss. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants