Skip to content

tarunbatra/site-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Site Scraper

App which scrapes sites. Duh!

How to use

SITE=http://tarunbatra.com npm start

Environment Variables

ENV Default Description
SITE Site to scrape
CONCURRENCY_LIMIT 5 Maximum concurrent requests

License

MIT

Releases

No releases published

Packages

No packages published