This repo contains the source code for the Course Browser website, hosted in production at https://coursebrowser.nl/. It utilizes a scraper to gather course information. The scraper lives in OsirisAPI.py. This system is build in the Django framework.
It aims to provide a usefull interface in which students can easily filter and browse courses to help with making a choice in them. It uses the scraper to fetch all courses from a requested faculty and caches the tables for one month.
Install python and the requirements using pip. Consult the django and django channels docs for information on how to deploy the system. It needs redis and postgresql as external dependencies.
The system makes use of celery to parallelize scraping. Make sure you start a celery working alongside the normal django process. Example script for production with 32 process in your pool:
export DJANGO_SETTINGS_MODULE=coursebrowser.settings
celery -A coursebrowser worker -l ERROR --concurrency 32For development simply swithc the exported django setting variable. You can easily use more workers then cores due to I/O waiting when doing network requests.
The Course Browser system has no official endorsement of any university whatsoever. Development and support done by Kolibri Solutions. For questions or inquiries contact info@kolibrisolutions.nl.
All rights reserved. All product names, logos, and brands are property of their respective owners. Use of these names, logos, and brands does not imply endorsement.