####About Main idea behind proxyHarvester is to get as reliable free proxy list as possible and maintaining it in real time. First thing harvester is doing is scraping all defined free proxy lists. Next, it check if each single proxy is healthy or sick. Sick proxies (most of them... free proxies are crap...) are removed from list. Healthy proxies are stored and constantly checked if still healthy. Healthy proxies are stored in python pickle file each 30s. To get as good proxy list as possible, harvester should run while whole scrapping processes.
Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Proxy Harvester - get free and healthy proxy
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Type||Name||Latest commit message||Commit time|
|Failed to load latest commit information.|