Go worker pool
Go
Switch branches/tags
Nothing to show
Latest commit a09d53c Jan 17, 2014 @stefantalpalaru update license
Permalink
Failed to load latest commit information.
examples update license Jan 16, 2014
.gitignore ignore a file created when using syntastic Mar 15, 2013
LICENSE initial commit Feb 10, 2013
README.md docs Apr 28, 2013
pool.go update license Jan 16, 2014
pool_test.go update license Jan 16, 2014

README.md

This is a generic worker pool for the Go language. It's useful when you want to limit the number of goroutines running in parallel.

Installation:

go install github.com/stefantalpalaru/pool

Compile and run the examples:

go run examples/pool_example.go
go run examples/web_crawler.go

The last example is actually an exercise from the Go tour modified to use a worker pool for fetching and processing the URLs. The need to limit the number of concurrent requests in real web scraping scenarios was what prompted the creation of this package.

You can see the godoc generated documentation online at godoc.org/github.com/stefantalpalaru/pool.