Skip to content
This repository has been archived by the owner on Apr 9, 2022. It is now read-only.
/ crawl-counter Public archive

Collect and count words found on websites

Notifications You must be signed in to change notification settings

einarolafs/crawl-counter

Repository files navigation

crawl-counter

Build Status

A CLI tool to collect all word found on a website and collect them onto a database in a local JSON format.

How to run

To start the program, simply run npm start -- --url http://domain.com

The program only does a shallow crawl and collect links for another run, to continue more crawls, run npm start -- --url http://domain.com

Get documentation

Code documentation is based on JSdocs, to build and view the documents locally run npm run docs

The tool is experimental, not in active develoopment!

About

Collect and count words found on websites

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published