Admin Crawl

With this plugin you are able to start a crawl. Before you start a crawl you should upload urls with the Admin Url Upload plugin. You can create more than one crawl folder. A crawl folder has an own crawldb, linkdb and index.

You can start a crawl with a depth (number of shards/segments) and a topN Parameter. topN means that you generate per shard N urls.

< Previous Next >