Skip to content

Crawler Detector is a Golang package for detecting bots/crawlers/spiders via the user agent.

License

Notifications You must be signed in to change notification settings

langaner/crawlerdetector

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

About Crawler Detector

Crawler Detector is a Golang package for detecting bots/crawlers/spiders via the user agent.

Installation

Run go get github.com/langaner/crawlerdetector.

Usage

detector := crawlerdetector.New()
isCrawler := detector.IsCrawler(r.Header.Get("User-Agent"))

if isCrawler {
    // Do something
}

Contributing

If you find a bot/spider/crawler user agent that Crawler Detector not detect, please submit a pull request with the regex pattern.

About

Crawler Detector is a Golang package for detecting bots/crawlers/spiders via the user agent.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages