Skip to content
This repository was archived by the owner on Apr 30, 2018. It is now read-only.

zacanger/scrapingnode

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrapingnode

A simple command-line wrapper around ineed.

Installation

npm i -g scrapingnode

Usage:

scrapingnode

Usage: scrapingnode <option> <url>
Option can be one of:
content   (which collects content) or
data      (which collects links, scripts, etc.) or
code      (which collects HTML comments, CSS, and JS)
all       (all of the above)

Example: scrapingnode code zacanger.com

You can leave off the https:///http:// if you want. Or not. Up to you.

You'll get a bunch of stuff you can really easily parse. Nice, huh?

Maybe do something like scrapingnode content blog.zacanger.com > zacs-blog.json, or scrapingnode code zacanger.com/p | jq .jsCode or something.

Contributions welcome.

License: WTFPL.

About

the tiniest little command-line scraper, with just one dependency.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published