Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

51 undetected bots #1952

Closed
liviuconcioiu opened this issue Sep 10, 2018 · 0 comments
Closed

51 undetected bots #1952

liviuconcioiu opened this issue Sep 10, 2018 · 0 comments
Assignees
Milestone

Comments

@liviuconcioiu
Copy link

AngleSharp/0.9.9
BUFF library user agent
CipaCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/example.com)
Companybook-Crawler (+https://www.companybooknetworking.com/)
DocBase Crawler/1.0
Feedspot http://www.feedspot.com
Hatena Pagetitle Agent/1.0
Hatena Star UserAgent/2
Hatena-Favicon2 (http://www.hatena.ne.jp/faq/)
Hatena::Bookmark/2.00 (Hatena::Bookmark; master;)
Hatena::Fetcher/0.01 (master) Furl/3.13
Hatena::Russia::Crawler/0.01
Hatena::Scissors/0.01
Hatena::UserAgent/0.02
HatenaBookmark/0.03 (compatible; entryimage-fetcher)
HatenaBookmark/4.0 (Hatena::Bookmark; Analyzer)
HatenaBookmark/4.0 (Hatena::Bookmark; Scissors)
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US
LinqiaMetadataDownloaderBot/1.0 (eng@linqia.com)
Mozilla/5.0 (compatible; AlphaBot/3.2; +http://alphaseobot.com/bot.html)
Mozilla/5.0 (compatible; DNS SSL/TLS HTTP HTML Website Security Scanner/0.2 beta; +https://www.htmlyse.com/)
Mozilla/5.0 (compatible; LetsearchBot/1.0; +http://letsearch.ru)
Mozilla/5.0 (compatible; Mappy/1.0; +http://mappydata.net/bot/)
Mozilla/5.0 (compatible; Nimbostratus-Bot/v1.3.2; http://cloudsystemnetworks.com)
Mozilla/5.0 (compatible; WorksOgCrawler/1.0.0;)
Mozilla/5.0 (compatible; YandexAccessibilityBot/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; poddirectory/2.1; +http://www.poddirectory.com/aboutUs)
Mozilla/5.0 (compatible; tracemyfile/1.0)
NinjaBot/2.0 (+http://www.imninjas.com)
OnPageBot (compatible; Googlebot 2.1; +https://bot.onpage.org/)
RankingBot2 -- https://varocarbas.com/bot_ranking2/
Seobility (SEO-Check; http://bit.ly/1dJuuzs)
Serf/1.3.8 (mod_pagespeed/1.12.34.2-0)
SuperPagesUrlVerifyBot/1.0
Telesphoreo
The Knowledge AI
Upflow/1.0
Yooo! Search Engine Bot BETA (http://yooo.nl/about.php)
adstxtlab.com Crawler
axios/0.18.0
bidswitchbot/1.0
btcrawler
http://www.nominet.org.uk/privacypolicy - **Yes the user agent is a url!**
muhstik-scan
muhstik-scan/1.0
muhstik/1.0
nanagogo-bot
struts-pwn (https://github.com/mazen160/struts-pwn_CVE-2017-9805)
twieve/1.0 (http://twieve.net)
zoomRank/3.0
@mimmi20 mimmi20 self-assigned this Sep 23, 2018
@mimmi20 mimmi20 mentioned this issue Sep 26, 2018
@mimmi20 mimmi20 added this to the 6.0.31 milestone Sep 26, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants