Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

A wget replacement written in Python3

branch: master

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

Octocat-spinner-32 utils
Octocat-spinner-32 .gitignore
Octocat-spinner-32 LICENSE.txt
Octocat-spinner-32 README.md
Octocat-spinner-32 TODO
Octocat-spinner-32 pwget.py
Octocat-spinner-32 pwget_test.py
README.md

pwget

A wget replacement written in Python3

Recursively downloads from http urls matching a regexp:

./pwget.py [-r url_regex] url1 [url2] ... [urln]

Options:
    -v --verbose:       verbose execution
    -h --help:          this help
    -r --regex:         regex for urls to download
    -c --cokiefile:     specify a cookie file to use
    -o --overwrite:     force overwritting of files
    -m --mirror:        only download if size differs
    -t --time:          time to sleep between requests in seconds (float)

Running

To download recursively urls matching a regex do:

For example:

./pwget.py -r http://slashdot.org/tag/microsoft http://slashdot.org

Will download http://slashdot.org, and recursed links matching 'http://slashdot.org/tag/microsoft'

Something went wrong with that request. Please try again.