Multi-Threaded Web Requests
Python
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
LICENSE.txt
README.md
__init__.py
mtwr.py
mtwr_example.py

README.md

mtwr - Multi-Threaded Web Requests

Simple python module that exposes a single function to execute web requests in parallel.

It supports http, https, ftp. IPv4 can be forced in case IPv6 causes slow requests.

Tested with python 2.7.2.

Usage

import mtwr
urls = ['https://www.google.com', 'http://www.python.org', 'ftp://mirrors.kernel.org']
results = mtwr.request_urls(urls, timeout=15, force_ipv4=True)
# {url1: data1, url2: data2, ...}

ISC License

https://github.com/shazbits/mtwr/blob/master/LICENSE.txt

Romain Dura

http://www.shazbits.com