Skip to content
The spider for ZeroNet search engine Horizon
JavaScript
Branch: node
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
Crawlers
Tests
Utils
ZeroNet
kibana
.eslintrc.json
.gitignore
.jsbeautifyrc
App.js
DataBase.js
Horizon.svg
LICENSE
README.md
cli.js
horizon-spider.code-workspace
horizon.drawio
package.json
yarn.lock

README.md

HorizonSpider - Nodejs

Basic concepts

The spider crawls each site in siteList and submit crawled links to zeronet.

Then zeronet processes them, and downloads those zites.

It continues to traversal siteList and crawls newly downloaded sites to get more links

Usage

Clone this repo and:

yarn

Config

Create .env file and add configs as follows:

ZeroNetPath=D:/ZeroNet
ZeronetDataPath=D:/ZeroNet/Data

Run

yarn crawl
You can’t perform that action at this time.