-
Download and Install NodeJS.
npm
package manager is automatically downloaded -
Axios is a "Promise based HTTP client for the browser and node.js."
$ npm install axios
- Cheerio is used here to implement jQuery methods in order to 'walk through' different elements of the rendered HTML document.
$ npm install cheerio
- fs library piped the contents to future_learn_courses.json
Check out scraper.js for how the above libraries were initially used
Example course:
"college": "Raspberry Pi Foundation & National Centre for Computing Education",
"title": "Introduction to Cybersecurity for Teachers",
"description": "Explore key concepts of cybersecurity to teach 14-16 year-old students with this online cybersecurity course supported by Google.",
"weeks": "3 weeks",
"hours": "2 hrs/week"