Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

return 404 when stage extras for an unversioned course url are requested #29043

Merged
merged 1 commit into from Jun 11, 2019

Conversation

davidsbailey
Copy link
Member

Background

Fixes https://app.honeybadger.io/projects/3240/faults/50002356

Investigation into the honeybadger error revealed that they all had one of the following two settings in the "parameters" section:

  • "HTTP_FROM" => "bingbot(at)microsoft.com",
  • "HTTP_FROM" => "googlebot(at)googlebot.com",

Internet research revealed that these search engine crawlers will keep requesting urls that return a 5xx, and need to receive a 404 or 410 in order to be told to stop requesting them.

Description

Return 404 for any request to an unversioned stage extras url such as those listed in the honeybadger events.

Copy link
Contributor

@maddiedierker maddiedierker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wow, great find! :shipit: glad to know there wasn't any user impact here, too

@davidsbailey davidsbailey merged commit 3e2f104 into staging Jun 11, 2019
@davidsbailey davidsbailey deleted the stage-extras-gone branch June 11, 2019 00:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants