Go
Latest commit 472907c Nov 19, 2014 @dustin Yay new for/range loop
Permalink
Failed to load latest commit information.
.gitignore
README.markdown
config.go
errors.go
pfetch.go
urls.example.xml

README.markdown

pfetch - A Parallel Periodic URL Fetcher Utility

This is a really simple twisted app, but it solves a real problem I had, so maybe it'll help you, too.

I've got a bunch of various URLs from which I pull down content regularly via cron to do some processing. Having a full-time process fetching all of them without worrying about cron job overlaps, network timeouts slowing things down, etc... is going to make my machine a lot happier.