Skip to content

v1.5.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 25 Sep 08:21
· 89 commits to main since this release
v1.5.0
9839439
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Big one. The proxy server grew up, the live list got a website, and there's a Python API now.

New

  • Live list website – https://maximilianfeix.github.io/proxy-scraper/ with search, filters, copy/download, country and latency charts and a trend over the last runs (#47)
  • Stable proxies – the list remembers how many runs in a row each proxy worked. "Stable 24 h+" filter and an "Up for" column on the website (#61)
  • Tampering check – a static page has to arrive byte for byte. Out of 270 working proxies, 54 injected something, mostly a <script> tag. Those are gone now (#46)
  • Provider and datacenter – ASN and provider name for every exit IP (offline, DB-IP), plus --no-datacenter. About 45 % of working proxies exit from datacenters (#49)
  • Proxy server – --rotate weighted|random|round-robin|fastest, --sticky SEC, choosing per request through the username (country-de-type-socks5-session-abc), SOCKS5 on the same port, dead proxies get re-checked every 5 minutes, --serve-host for Docker (#48, #43)
  • Status and metrics – /__proxy-scraper/status as JSON and /__proxy-scraper/metrics for Prometheus/Grafana (#67)
  • --recheck live – starts from the public list and checks it again from your own network. 517 of 1,169 worked, in 31 s instead of a full scan (#60)
  • Python API – from proxyscraper import find_proxies, same checks as the CLI (#50)
  • Shell completion – eval "$(proxy-scraper --completion zsh)", also bash and fish (#62)

Next

PyPI (#42), blocklist info for exit IPs (#66, measured: 29 % are on SpamCop) and protocol detection on the same connection (#44), see the v1.6 milestone.

pipx install git+https://github.com/maximilianfeix/proxy-scraper.git
# or
docker run --rm ghcr.io/maximilianfeix/proxy-scraper --want 20

Full list: CHANGELOG.md · v1.4.0...v1.5.0

Assets 4
Loading