Rust libraries for building HTTP crawlers with interchangeable network transports.
rustycrawl-http-clientprovides a reqwest-like HTTP API over Hyper, automatic cookie storage, and a standard Tokio HTTP/HTTPS client with connection pooling.hyper-connector-mullvadprovides a Hyper connector backed by up to five userspace WireGuard tunnels discovered from local Mullvad configuration. It defaults to four tunnels and can filter relays by country or continent.
The Mullvad connector implements Hyper's connection abstraction, so Hyper owns HTTP connection pooling and protocol behavior. Connection failures are returned without replay; an affected tunnel is repaired for future connections.
The original code in this repository is licensed under either the Apache License, Version 2.0 or the MIT license, at your option.
hyper-connector-mullvad currently depends on GPL-3.0 libraries
wireguard-hyper-connector and wireguard-netstack. Downstream distribution
must account for those dependencies' license obligations.