Requirements:
- Chrome
- node.js
- yarn
- patience
Scripts: "yarn crawl" - Saves data as data.json on root dir. "yarn upload" - Uploads data.json file to the database.
Note: This crawler was designed for crawling websites built with frameset(HTML4). Therefore please be aware that the process of this crawling system might be differ from the latest(2023/03/03) puppeteer method.