Skip to content

v1.6.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 26 Sep 08:56
· 33 commits to main since this release
v1.6.0
5c9ed7c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

The list got faster and easier to find, the proxy server can run on its own for days, and everything is English now.

New

  • Blocklist check – every exit IP is looked up on SpamCop, with --no-blocklisted to skip listed ones. In today's list 28 % are listed. If your DNS resolver gets refused it says so instead of guessing (#66)
  • Live list every hour – instead of every 6 hours, a full run only takes about 3 minutes. "Stable" still means 24 h (#111)
  • Pages per protocol and country – socks5/, country/de/ and so on, each with a proxies.txt, plus a sitemap (#121)
  • Password for the proxy server – PROXY_SCRAPER_SERVE_PASSWORD or --serve-password, for HTTP, SOCKS5 and the status page. Plus a compose.yaml that runs it in Docker (#103)
  • The server refills itself – --serve-refill 6 checks fresh proxies in the background every 6 hours and adds the hits, so a long-running server doesn't run dry (#109)
  • -o - prints the hits to stdout for pipes, the interface moves to stderr (#105)
  • Discord bot in bot/ – posts the live list, answers /proxies, /proxy, /stats (#74, #75)
  • New website and logo, README redesign, WCAG fixes on the site, and the whole repo is in English now (#71, #72, #73, #79, #80)

Fixed

  • A target that's down no longer gets working proxies disabled in the proxy server, IPv6 targets work over CONNECT and SOCKS5 (#82)
  • Proxies still being confirmed when --want is reached no longer count as dead, outdated sources get another look every 3 days (#83)
  • A handful of smaller robustness bugs (#84)

Next

PyPI (#42), protocol detection on the same connection (#44), and a few Hacktoberfest issues if you want to help. See the v1.7 milestone.

pipx install git+https://github.com/maximilianfeix/proxy-scraper.git
# or
docker run --rm ghcr.io/maximilianfeix/proxy-scraper --want 20

Full list: CHANGELOG.md · v1.5.0...v1.6.0

Assets 4
Loading