Working with Scraping Database

Jump to bottom Edit New page

Irwan Fathurrahman edited this page Sep 27, 2016 · 2 revisions

Scraping Database

Scraping database is used for getting latest data from trusted website.

http://ncap.careerhelp.org.za/, for getting campus and occupation
http://regqs.saqa.org.za/search.php, for getting courses.

Scraping Database can be done with make scraping. It will update database and save new record if it is not already in database.

There is also other command: make clean-scraping. It will delete all of current database for campus, course and occupation and getting new data.

After scraping data is done, don't forget to make updateindex, for updating searching feature. (for more info)