Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
A wget replacement written in Python3
branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
utils Saving some utils
.gitignore Initial commit
LICENSE.txt initial commit
README.md Upgrade README
TODO TODO
pwget.py Unicode fix, and python3 version unpinned
pwget_test.py remove some prints

README.md

pwget

A wget replacement written in Python3

Recursively downloads from http urls matching a regexp:

./pwget.py [-r url_regex] url1 [url2] ... [urln]

Options:
    -v --verbose:       verbose execution
    -h --help:          this help
    -r --regex:         regex for urls to download
    -c --cokiefile:     specify a cookie file to use
    -o --overwrite:     force overwritting of files
    -m --mirror:        only download if size differs
    -t --time:          time to sleep between requests in seconds (float)

Running

To download recursively urls matching a regex do:

For example:

./pwget.py -r http://slashdot.org/tag/microsoft http://slashdot.org

Will download http://slashdot.org, and recursed links matching 'http://slashdot.org/tag/microsoft'

Something went wrong with that request. Please try again.