jfcrawler

> gem install nokogiri
> gem install rubyzip


> ruby crawl.rb

Usage: crawl.rb [options] url
    -p, --prefix PREFIX_URL          URL to prefix each request. Use this when crawling archive websites
    -s, --list                       Lists all forums and their id
    -f, --forum id1,id2,id3,..       Select forum
    -t, --threads THREAD             Number of threads to use
    -w, --wait SECONDS               Time to wait between download requests
    -c, --cache                      Enable the download cache
    -r, --nocurse                    Disable curse gui
    -h, --help                       Display this screen