GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.
Sign up
Fetching latest commit…
| Type | Name | Latest commit message | Commit time |
|---|---|---|---|
| Failed to load latest commit information. | |||
|
data | ||
|
|
DB.py | ||
|
|
QQWry.Dat | ||
|
|
README.md | ||
|
|
__init__.py | ||
|
|
api.py | ||
|
|
config.py | ||
|
|
crawler.py | ||
|
|
logger.py | ||
|
|
proxypool.py | ||
|
|
proxysites.py | ||
|
|
pyip.py | ||
|
|
test.py | ||
|
|
validator.py | ||
Crawl and validate proxies from Internet
requests
gevent
lxml
beautifulsoup4
just run in terminal
python proxypool.py
then
http://localhost:8000
or
http://localhost:8000/?num=1&port=80&type=3&protocol=http&area=北京
the parameter "type" means anonymous level
0: unknown
1: transparent
2: anonymous
3: high anonymous