An advanced web-crawler written in PHP.
Blazingly Fast, High Performant, Scalable Web Crawler Engine 💨
An Android app crawling framework, making automatic crawling mobile apps super easy! (if possible, iOS will be supported after Android version)
Multi-threaded Web crawler with support for custom fetching and persisting logic
Small web crawler developer in Java and Spring Boot
A miniature Java Search Engine using the Rapid Automatic Keyword Extraction Framework ( RAKE ) and HashMaps
An attempt to make a very basic search engine using php, ajax and mysql
Example to demonstrate the usage of cached queues across multiple requests.
mercator scheme/rate-limiting/scheduling part of whirlpool project; handles crawler priority and politeness
🤖 A Google extension that facilitates project management with various tools
DEX8 SDK is software development kit for DEX8.com platform.
This is a JavaScript toolkit for browser crawler testing.
Plan to use https://github.com/sxoxgxi/WebCrawler from the web
Functionality to Extract Social data.
BugSearch é um motor de pesquisa de páginas indexadas pelo crawler BugSearch.Crawler. O projeto é dividido em duas partes: o lado do Bot (Bot side) e o lado do Cliente (Client side).
This project named "Landslide Detection and Prediction" was done during my summer internship under Visiting Associate Prof. Gagan Raj Gupta at IIT - Bhilai.
A DSL aimed at making writing web scrapers/crawlers a breeze
Add a description, image, and links to the crawler-engine topic page so that developers can more easily learn about it.
To associate your repository with the crawler-engine topic, visit your repo's landing page and select "manage topics."