- Scraper was built originally to scrap blog post from a given site
- The functions directory holds specific webiste DOM traversal functions, site url's
- Generic
for loopwas used because of the problems withasync/awaitinforEachimplementations - Add your write file to the directory
- Add your specific DOM traversal for the website to be scraped.
- Require you traversal file, making sure your file exports the site_url, write file name, urls and the traversal function.
- Run
node scraper.jsin the working directory.
-
Notifications
You must be signed in to change notification settings - Fork 0
mmason33/Node-Scraper
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Generic web scraper in Node
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published