A Small Web Crawler made with TypeScript
This webcrawler takes a starting url and collects urls relative to the domain. The crawler will visit all possible relative urls.
The starting url location can be changed at the bottom of index.ts
To compile and run the application, you must first have NodeJS
and TypeScript
installed
To install TypeScript, run the command:
npm i -g typescript
To compile the TypeScript into JavaScript, run the command:
tsc index.ts
The command will output a file called index.js
To run the compiled application run the command:
node index.js