Skip to content

LeoGuagenti/web-crawler-v2

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

web-crawler-v2

A Small Web Crawler made with TypeScript

Usage

This webcrawler takes a starting url and collects urls relative to the domain. The crawler will visit all possible relative urls.
The starting url location can be changed at the bottom of index.ts

To compile and run the application, you must first have NodeJS and TypeScript installed

Installing TypeScript

To install TypeScript, run the command:

npm i -g typescript

Compiling To JavaScript

To compile the TypeScript into JavaScript, run the command:

tsc index.ts

The command will output a file called index.js

Running the Final Application

To run the compiled application run the command:

node index.js

Releases

No releases published

Packages

No packages published