Skip to content

Commit

Permalink
Add three user agents (#155)
Browse files Browse the repository at this point in the history
  • Loading branch information
MaxGiting committed Dec 15, 2016
1 parent b5179f3 commit 34d45b1
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 0 deletions.
3 changes: 3 additions & 0 deletions src/Fixtures/Crawlers.php
Expand Up @@ -25,6 +25,7 @@ class Crawlers extends AbstractProvider
'2ip\.ru',
'404checker',
'^bluefish ',
'^DangDang',
'^FDM ',
'^git\/',
'^Goose\/',
Expand Down Expand Up @@ -308,6 +309,7 @@ class Crawlers extends AbstractProvider
'HubSpot Connect',
'HubSpot Marketing Grader',
'HyperZbozi.cz Feeder',
'i2kconnect\/',
'ichiro',
'IdeelaborPlagiaat',
'IDG Twitter Links Resolver',
Expand Down Expand Up @@ -515,6 +517,7 @@ class Crawlers extends AbstractProvider
'Redirect Checker Tool',
'ReederForMac',
'request\.js',
'resolver\/[0-9]',
'ResponseCodeTest\/[0-9]',
'RestSharp',
'RetrevoPageAnalyzer',
Expand Down
3 changes: 3 additions & 0 deletions tests/crawlers.txt
Expand Up @@ -2410,3 +2410,6 @@ Mozilla/5.0 (compatible; informatique at mixdata dot com/0.6; +http://t.co/GSRLL
Mozilla/5.0 (compatible; Feedwind/2.0; +http://feed.mikle.com/support/description/)
Mozilla/5.0 (compatible; Feedwind/3.0; +http://feed.mikle.com/support/description/)
CAAM/0.1 (CAAM; caam dot crwlr at gmail dot com)
i2kconnect/"1.7.0"
resolver/0.1.12 (+http://github.com/andris9/resolver)
DangDang

0 comments on commit 34d45b1

Please sign in to comment.