A wget replacement written in Python3
Python
Switch branches/tags
Nothing to show
Permalink
Failed to load latest commit information.
utils Saving some utils Aug 2, 2013
.gitignore Initial commit Aug 13, 2012
LICENSE.txt initial commit Aug 13, 2012
README.md Upgrade README Aug 2, 2013
TODO TODO Aug 13, 2012
pwget.py Unicode fix, and python3 version unpinned Aug 31, 2014
pwget_test.py remove some prints Aug 2, 2013

README.md

pwget

A wget replacement written in Python3

Recursively downloads from http urls matching a regexp:

./pwget.py [-r url_regex] url1 [url2] ... [urln]

Options:
    -v --verbose:       verbose execution
    -h --help:          this help
    -r --regex:         regex for urls to download
    -c --cokiefile:     specify a cookie file to use
    -o --overwrite:     force overwritting of files
    -m --mirror:        only download if size differs
    -t --time:          time to sleep between requests in seconds (float)

Running

To download recursively urls matching a regex do:

For example:

./pwget.py -r http://slashdot.org/tag/microsoft http://slashdot.org

Will download http://slashdot.org, and recursed links matching 'http://slashdot.org/tag/microsoft'