WIP !!!!
Scrutari is a Latin deponent verb meaning "to search," "probe," "examine carefully," or "investigate".
A method to compile a list of URLs based on robot files, sitemaps, and page crawling.
- Dependency-light
- Plays nicely with existing workflows
npm install scrutari
URL=[website] scrutari
# URL=https://www.sunsweet.com scrutari
URL=[website] scrutari -v
URL=[website] scrutari -o
URL=[website] scrutari | [script]
import scrutari from "scrutari";const scrutari = require("scrutari");