Skip to content

Commit

Permalink
fixes #5681 - fix generic bot detection
Browse files Browse the repository at this point in the history
  • Loading branch information
sgiehl committed Nov 17, 2017
1 parent 7b6dedc commit 12adf85
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 1 deletion.
8 changes: 8 additions & 0 deletions Tests/fixtures/bots.yml
Original file line number Diff line number Diff line change
Expand Up @@ -724,6 +724,14 @@
user_agent: COMODO SSL Checker
bot:
name: Generic Bot
-
user_agent: 'HybridBot (hybrid.ru/about. If our bot caused problems please contact us. Contact email: m.lyashkov@targetix.net)'
bot:
name: Generic Bot
-
user_agent: Mozilla/5.0 (compatible; Shareaholicbot/2.0; +http://www.shareaholic.com/bot)
bot:
name: Generic Bot
-
user_agent: niki-bot
bot:
Expand Down
2 changes: 1 addition & 1 deletion regexes/bots.yml
Original file line number Diff line number Diff line change
Expand Up @@ -1568,5 +1568,5 @@
name: 'The Apache Software Foundation'
url: 'http://www.apache.org/foundation/'

- regex: '[a-z0-9\-_]*((?<!cu)bot(?>! TAB|$)|crawler|crawl|checker|archiver|transcoder|spider)([^a-z]|$)'
- regex: '[a-z0-9\-_]*((?<!cu)bot(?! TAB)|crawler|crawl|checker|archiver|transcoder|spider)([^a-z]|$)'
name: 'Generic Bot'

0 comments on commit 12adf85

Please sign in to comment.