Skip to content
/ scrape Public

🪚 minimal scraping tool for personal use

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-Apache
MIT
LICENSE-MIT
Notifications You must be signed in to change notification settings

hoodie/scrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrape

Simple tool to download and parse HTML

Usage: scrape [OPTIONS] <URL> [SELECTOR]

Arguments:
  <URL>       which page to download
  [SELECTOR]  select html from the downloaded page (css selector)

Options:
  -a, --attribute <ATTRIBUTE>  select a certain attribute
  -q, --quiet                  do not print progress or warnings
  -m, --mozilla                pretend to be Mozilla, like everyone else
      --headers                print headers [env: HEADERS=]
  -n, --count <COUNT>          print count nodes only
  -h, --help                   Print help
  -V, --version                Print version

About

🪚 minimal scraping tool for personal use

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-Apache
MIT
LICENSE-MIT

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages