scrape

distributed and asynchronous image scraper in elixir, currently can scrape images from 4chan threads. can download a full thread of images in under 10 seconds!

Usage

compile:

mix escript.build

instead of compiling, you can just use the scrape executable

set download directory:

./scrape --dir path/to/download/dir

If dir is not set, it'll default to the current working directory

download all rare maymay images from 4chan thread:

./scrape --chan http://boards.4chan.org/vp/thread/210003