Golang Web Scraper
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md
client.go
client_test.go
crawler.go
crawler_test.go
helpers_test.go
scour.go
scour_test.go
selection.go

README.md

Scour

Goutte-like web scraper for Go.

You can view the API docs here: http://godoc.org/github.com/brettdonohoo/scour

Overview

Scour is a convenience library for web scraping with Go.

Scour wraps/uses goquery for parsing markup and is heavily influenced by Goutte.

Installation

Make sure you have a working Go environment (go 1.1 is required). See the install instructions.

To install scour.go, simply run:

$ go get github.com/brettdonohoo/scour

Make sure your PATH includes to the $GOPATH/bin directory so your commands can be easily used:

export PATH=$PATH:$GOPATH/bin