Some new UA #12

Closed
Vrtak-CZ opened this Issue Jun 12, 2012 · 3 comments

3 participants

@Vrtak-CZ

Please add:

  • BingBot
  • SeznamBot
  • YandexBot
  • etc...
"Python-urllib/2.4",
"SeznamBot/3.0 (+http://fulltext.sblog.cz/)",
"Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)",
"GSLFbot",
"Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)",
"Googlebot-Image/1.0",
"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)",
"Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+)",
"Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; +http://tweetedtimes.com)",
"facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)",
"facebookplatform/1.0 (+http://developers.facebook.com)",
"EventMachine HttpClient",
"Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)",
"facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)",
"Mozilla/5.0 (compatible; ltbot/1.3; bot@language-tools.com)",
"DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)",
"Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 1 subscribers; feed-id=14515760453700115068)",
"SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)",
"Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)",
"msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)",
"Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620",
"Mozilla/5.0 (compatible; discobot/2.0; +http://discoveryengine.com/discobot.html)",
"Mozilla/5.0 (compatible) Feedfetcher-Google; (+http://www.google.com/feedfetcher.html)",
"Java/1.6.0_24",
"Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)",
"Mozilla/5.0 (X11; Linux x86_64) KHTML/4.8.1 (like Gecko) Konqueror/4.8",
"Mail.RU/2.0",
"TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)",
"Python-urllib/2.7",
"Mozilla/5.0 (compatible; oBot/2.3.1; +http://www-935.ibm.com/services/us/index.wss/detail/iss/a1029077?cntxt=a1027244)",
"Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/)",
"Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)",
"Mozilla/5.0 (compatible; AhrefsBot/3.0; +http://ahrefs.com/robot/)",
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b",
"Mozilla/5.0 (compatible; OpenindexDeepSpider/Nutch-1.5-dev; +http://www.openindex.io/en/webmasters/spider.html)",
"Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.webarchiv.cz)",
"Mozilla/5.0 (compatible; Mail.RU/2.0)",
"Java/1.6.0_23",
"Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)",
"Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)",
"Java/1.6.0_20",
"Mozilla/5.0 (compatible; DCPbot/1.2; +http://domains.checkparams.com/)",
"SEOstats 2.0.9          https://github.com/eyecatchup/SEOstats",
"Mozilla/5.0 (compatible; Plukkie/1.4; http://www.botje.com/plukkie.htm)",
"Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; +http://fulltext.sblog.cz/screenshot/)",
"Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)",
"Java/1.6.0_31",
"Java/1.6.0_21",
"Googlebot-Video/1.0",
"Mozilla/5.0 (compatible; OpenindexShallowSpider/Nutch-1.5-dev; +http://www.openindex.io/en/webmasters/spider.html)",
"Java/1.7.0",
"Mozilla/4.77 [en] (X11; I; IRIX;64 6.5 IP30)",
"Java/1.6.0_02",
"Wotbox/2.0 (bot@wotbox.com; http://www.wotbox.com)",
"Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)",
"Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)",
"UnwindFetchor/1.0 (+http://www.gnip.com/)",
"LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)",
"MetaURI API/2.0 +metauri.com",
"Jolibot/1.0 (+http://www.jolicloud.com/)",
"Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com)",
"Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)",
"ShowyouBot (http://showyou.com/crawler)",
"Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)",
"Java/1.6.0_16",
"netEstate NE Crawler (+http://www.sengine.info/)",
"Mozilla/5.0 (compatible; Jetslide; +http://jetsli.de/crawler)",
"percbotspider <ops@percolate.com>",
"newsme/1.0; feedback@news.me",
"Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)",
"Mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com)",
"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
@3rd-Eden
Owner

Bots/spiders are now categorised under the device property.

@pascalmartin

this user agent for iphone calendar ical subscription not work

iOS/6.1.2 (10B146) dataaccessd/1.0

this is for Microsoft Outlook ical subscription Only os work not browser
Microsoft Office/14.0 (Windows NT 6.1; Microsoft Outlook 14.0.6129; Pro)

@3rd-Eden
Owner

Closing this, all changes and regexp updates should be made against regexp database that we use, not this module.

@3rd-Eden 3rd-Eden closed this Nov 18, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment