Distributed Elegant Scraper and Crawler Framework for Rust.
-
Updated
Dec 3, 2019 - Rust
Distributed Elegant Scraper and Crawler Framework for Rust.
Rust制作的BiliBili漫画下载器:无环境依赖,高性能,支持导出pdf、epub、zip
Spider ported to Node.js
Spider ported to Python
Rust Web Crawler saving pages on Redis
Dyer is designed for reliable, flexible and fast web crawling, providing some high-level, comprehensive features without compromising speed.
Rust制作的BiliBili漫画下载器:无环境依赖,高性能,支持导出pdf、epub、zip
The fastest web crawler written in Rust. Maintained by @a11ywatch.
Add a description, image, and links to the spider topic page so that developers can more easily learn about it.
To associate your repository with the spider topic, visit your repo's landing page and select "manage topics."