Skip to content

Write a new data scraper for getting previous quarter's data #33

@phi-line

Description

@phi-line

This would involve going to each quarter's previous data and using Beautiful Soup to find gather all the departments, all of the child courses, and all of the child sections. Then, using the same format as the current data scraper, make a database for every quarter.

The resulting database should be named using this schema:

[year][quarter][campus]_database.json

201812_database.json


    201812: The 2017-2018 academic year runs from July 1, 2017 to June 30, 2018. Therefore the ending year, 2011 is used to refer to the entire year.

    201812: The fifth digit represent the quarter:
        1 for Summer
        2 for Fall
        3 for Winter
        4 for Spring

    201812: The last digit refers to the college, 1 for Foothill and 2 for De Anza. 

This would make our local database very consistent with the one found on MyPortal, as the GET request made for the tabular course data follows this same format.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions