Staff f22: Add job to update MongoDB for a single quarter / subject area

[pconrad]

Overview

In this PR, we roll out a new feature that allows admins to update a MongoDB database with course information via an asynchronous job.

The intent is for this new feature to open up several new lines of development, especially for the -1 teams on courses:

Especially, this opens up the possibility to develop searches that are not supported by the UCSB Courses API, such as search by course (over multiple quarters) and search by instructor (over multiple quarters.)

It also opens up the possibility to add similar jobs that will:

• load all subject areas in a given quarter.
• load all subject areas over a range of quarters.

User Story

As an admin

• I can specify a quarter and a subject area and launch a job that loads data for that quarter and subject area into the MongoDB database
• So that developers can work on queries that require such a database

How to Test / Use this feature

Here's an outline, followed by some animations

1. Configure your app for a fresh MongoDB database; go see the data that is loaded
2. Login as an admin
3. Go to Admin / Load Subjects to make sure that the subject areas are loaded (this only needs to be done once)
4. Go to Admin / Manage Jobs
5. Specify Update Course Data
6. Specify quarter and subject area
7. Click "Update"
8. Wait for job to finish. It should report how many courses were loaded or updated
9. See results in MongoDb

Step 1: See MongoDB data:

This animation shows how to look at and do queries on MongoDB data:

Steps 2-3: Login as Admin, Load Subjects

Steps: 4-8: Running the job and waiting for it to finish (in this case, MATH courses in W23):

Step 9: See the MATH courses

The query is:

{ 'courseInfo.quarter' : '20231', 'courseInfo.courseId': { $regex: /MATH/ }}