Skip to content

Latest commit

 

History

History
16 lines (13 loc) · 415 Bytes

README.md

File metadata and controls

16 lines (13 loc) · 415 Bytes

Site Scraper

App which scrapes sites. Duh!

How to use

SITE=http://tarunbatra.com npm start

Environment Variables

ENV Default Description
SITE Site to scrape
CONCURRENCY_LIMIT 5 Maximum concurrent requests

License

MIT