Skip to content

Commit

Permalink
Merge branch 'master' into master
Browse files Browse the repository at this point in the history
  • Loading branch information
JayBizzle committed Mar 19, 2024
2 parents 3cf248f + dc35e47 commit 3b8486a
Show file tree
Hide file tree
Showing 4 changed files with 8 additions and 5 deletions.
2 changes: 1 addition & 1 deletion raw/Crawlers.json

Large diffs are not rendered by default.

6 changes: 3 additions & 3 deletions raw/Crawlers.txt
Original file line number Diff line number Diff line change
Expand Up @@ -140,7 +140,6 @@ axios\/
a\.pr-cy\.ru
B-l-i-t-z-B-O-T
Backlink-Ceck
backlink-check
BacklinkHttpStatus
BackStreet
BackupLand
Expand Down Expand Up @@ -456,8 +455,7 @@ Google Page Speed Insights
Google PP Default
Google Search Console
Google Web Preview
Google-Ads-Creatives-Assistant
Google-Ads-Overview
Google-Ads
Google-Adwords
Google-Apps-Script
Google-Calendar-Importer
Expand Down Expand Up @@ -673,6 +671,7 @@ limber\.io
Link Valet
LinkAlarm\/
LinkAnalyser
link-check
linkCheck
linkdex
LinkExaminer
Expand Down Expand Up @@ -781,6 +780,7 @@ NameFo\.com
Nameprotect
nationalarchives
Navroad
nbertaupete95
NearSite
Needle
Nessus
Expand Down
2 changes: 2 additions & 0 deletions src/Fixtures/Crawlers.php
Original file line number Diff line number Diff line change
Expand Up @@ -435,6 +435,7 @@ class Crawlers extends AbstractProvider
'g00g1e\.net',
'ganarvisitas',
'gdnplus\.com',
'GeedoProductSearch',
'geek-tools',
'Genieo',
'GentleSource',
Expand Down Expand Up @@ -968,6 +969,7 @@ class Crawlers extends AbstractProvider
'pshtt, https scanning',
'PTST ',
'PTST\/[0-9]+',
'pulsetic\.com',
'Pump',
'Python-httplib2',
'python-httpx',
Expand Down
3 changes: 2 additions & 1 deletion tests/crawlers.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3665,4 +3665,5 @@ SpeedKit
Amazon CloudFront
link-check/5.2.0
Mozilla/5.0/Firefox/42.0 - nbertaupete95(at)gmail.com
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview) Chrome/100.0.4896.127 Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview) Chrome/100.0.4896.127 Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GeedoProductSearch; +http://www.geedo.com/product-search.html) Chrome/79.0.3945.88 Safari/537.36

0 comments on commit 3b8486a

Please sign in to comment.