Skip to content

devjiwonchoi/frameset-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Requirements:

  • Chrome
  • node.js
  • yarn
  • patience

Scripts: "yarn crawl" - Saves data as data.json on root dir. "yarn upload" - Uploads data.json file to the database.

Note: This crawler was designed for crawling websites built with frameset(HTML4). Therefore please be aware that the process of this crawling system might be differ from the latest(2023/03/03) puppeteer method.

About

Crawler built with Puppeteer.js for crawling into Classic HTML4 frameset websites.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published