Web Crawler HTTP

Basic web crawler which represents the linking structure of the website

The purpose of the application is to scan a website and generate a report detailing its internal linking structure. Typically, such tools are utilized by web marketers and experts in search engine optimization (SEO)

How to run the application

Git clone the repo

$ git clone https://github.com/sssshefer/web-crawler-http.git

Check all tests for the application

$ npm run test

Run the application

$ npm run start https://linkToYouWebsite.com