Open source, multi-threaded website crawler written in C#, persisting in IBM's Cloudant NoSQL DB and configured for a Linux Docker image.
-
Updated
Dec 8, 2022 - C#
Open source, multi-threaded website crawler written in C#, persisting in IBM's Cloudant NoSQL DB and configured for a Linux Docker image.
BugSearch é um motor de pesquisa de páginas indexadas pelo crawler BugSearch.Crawler. O projeto é dividido em duas partes: o lado do Bot (Bot side) e o lado do Cliente (Client side).
Shark (Plunder)可配置、插件化的爬虫引擎,二次开发框架。Configurable, pluginable crawler engine, secondary development framework.
Add a description, image, and links to the crawler-engine topic page so that developers can more easily learn about it.
To associate your repository with the crawler-engine topic, visit your repo's landing page and select "manage topics."