-
Notifications
You must be signed in to change notification settings - Fork 36
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve bot detection regex #21
Merged
Merged
Commits on Aug 5, 2012
-
This commit improves the bot detection regex by: - adding a number of missing strings, such as alexa, facebookexternalhit, feedburner, nagios, postrank, pingdom, slurp, and yahoo! - removing redundant strings such as googlebot and robot (redundant because of the inclusion of a general "bot" string) - consolidate similar strings ("crawler" and "crawling" became "crawl(er|ing)") - alphabetize the list of bots
Configuration menu - View commit details
-
Copy full SHA for fb9a792 - Browse repository at this point
Copy the full SHA fb9a792View commit details -
Add "google web preview" to bot detection regex
To generate previews on the fly, Google uses the user-agent "Google Web Preview" (the fully-qualified user-agent you see in your server logs may change from time to time) to render images on demand. This commit adds "google web preview" to the bot detection regex.
Configuration menu - View commit details
-
Copy full SHA for a507269 - Browse repository at this point
Copy the full SHA a507269View commit details
Commits on Aug 6, 2012
-
Add yandex to bot-detecting regex
This commit adds "yandex" to the list of bots, to detect the popular Russian search engine.
Configuration menu - View commit details
-
Copy full SHA for 1f426c5 - Browse repository at this point
Copy the full SHA 1f426c5View commit details -
This commit improves the bot detection regex by: - adding a number of missing strings, such as alexa, facebookexternalhit, feedburner, nagios, postrank, pingdom, slurp, and yahoo! - removing redundant strings such as googlebot and robot (redundant because of the inclusion of a general "bot" string) - consolidate similar strings ("crawler" and "crawling" became "crawl(er|ing)") - alphabetize the list of bots
Configuration menu - View commit details
-
Copy full SHA for 76dc372 - Browse repository at this point
Copy the full SHA 76dc372View commit details -
Add "google web preview" to bot detection regex
To generate previews on the fly, Google uses the user-agent "Google Web Preview" (the fully-qualified user-agent you see in your server logs may change from time to time) to render images on demand. This commit adds "google web preview" to the bot detection regex.
Configuration menu - View commit details
-
Copy full SHA for c65c2c2 - Browse repository at this point
Copy the full SHA c65c2c2View commit details -
Add yandex to bot-detecting regex
This commit adds "yandex" to the list of bots, to detect the popular Russian search engine.
Configuration menu - View commit details
-
Copy full SHA for 34318e8 - Browse repository at this point
Copy the full SHA 34318e8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 97790f7 - Browse repository at this point
Copy the full SHA 97790f7View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.