Skip to content

A simple program for scraping studweb. Designed to handle multiple schools. Inspired by @flexd

Notifications You must be signed in to change notification settings

larhauga/studweb

Repository files navigation

Studweb web scraper

This is a web scraper that use the Python implementation of Mechanize to crawl the Norwegian student webpage for higher education. This will scrape the grades from the courses that have been taken, and can be used to notify the student when new grades are out.

This script supports multiple school, and can filter out the courses. If you are taking multiple bachelor's or a bachelor and a masters, you can filter the results as to only count the current courses.

This script supports notification through push services like NotifyMyAndroid (NMA), Prowl, and pushover. It can also notify through email, where a SMTP server is needed. This is tested with gmail using TLS.

Getting started

To get started you need to create a configuration file that is based on config_sample.py. Copy this to config.py

cp config_sample.py config.py

Edit this to satisfy your needs, and at least update username and password.

Using virtualenv's load in the requirements.txt.

pip install -r requirements.txt

Login methods

In the configuration file there are support for two different login methods. This includes feide login and with personal id and pin code. The personal id with pin code are prefered, but feide can be used by setting the FEIDE variable to True.

Feide login requires an aditional configuration file called feide.conf. A sample file of this is provided as feide_sample.conf.

Running it as cron

On a linux box create a file called something like /etc/cron.d/studweb with the following content.

# Studweb
# The first path can be to the virtualenv or /usr/bin/python
# The second path is to the code repository location and the studweb file
# This cron is running monday - friday every hour between and including 8 - 16.
0 8-16 * * 1-5 /path/to/virtualenv/studweb/bin/python /path/to/code/studweb/studweb.py

About

A simple program for scraping studweb. Designed to handle multiple schools. Inspired by @flexd

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages