SubCrawl is a modular framework for discovering open directories, identifying unique content through signatures and organizing the data with optional output modules, such as Elastic.
-
Updated
May 20, 2024 - Python
SubCrawl is a modular framework for discovering open directories, identifying unique content through signatures and organizing the data with optional output modules, such as Elastic.
A frontend for ODCrawler, an Open Directory search engine.
Automate search hidden directories and files on server
A reddit bot that scans ODs over at /r/OpenDirectories and submits the results to the ODCrawler discovery server
useful little things
Chrome extension written in Vue that uses Google's searching power
😈 A parallel open directory mapper.
RoR application that downloads URLs in background processes (sidekiq) using youtube-dl, wget and utorrent. Works well with https://github.com/riencroonenborghs/od-manager
Add a description, image, and links to the opendirectory topic page so that developers can more easily learn about it.
To associate your repository with the opendirectory topic, visit your repo's landing page and select "manage topics."