Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Branch: master
Fetching contributors…

Cannot retrieve contributors at this time

21 lines (14 sloc) 0.756 kB

This is a generic worker pool for the Go language. It's useful when you want to limit the number of goroutines running in parallel.

Installation:

go install github.com/stefantalpalaru/pool

Compile and run the examples:

go run examples/pool_example.go
go run examples/web_crawler.go

The last example is actually an exercise from the Go tour modified to use a worker pool for fetching and processing the URLs. The need to limit the number of concurrent requests in real web scraping scenarios was what prompted the creation of this package.

You can see the godoc generated documentation online at godoc.org/github.com/stefantalpalaru/pool.

Jump to Line
Something went wrong with that request. Please try again.