Skip to content

Conversation

@mbertrand
Copy link
Member

@mbertrand mbertrand commented Sep 5, 2024

What are the relevant tickets?

Description (What does it do?)

  • Update the OLL ETL pipeline to use a new column in the google sheet for secondary topics (and updates the downloaded csv included in the repo)
  • Update learning_resources.utils.get_year_and_semester and learning_resources.constants.semester_mapping so that semester values are consistently capitalized.

How can this be tested?

Run the following, it should complete without errors:

./manage.py backpopulate_oll_data

You can also try this to ingest directly from the google sheet instead of the csv provided in this repo:

./manage.py backpopulate_oll_data --sheets_id 1bWS-mqmuVraseMfY2YRu6gRnhXnjAS2N8CLiw4Tl8PE

Afterwards make sure that 60 results are returned at http://open.odl.local:8062/search/?platform=oll and that the OCW courses ingested from OLL all have capitalized first letters in their semester values.

@mbertrand mbertrand added Needs Review An open Pull Request that is ready for review Work in Progress and removed Needs Review An open Pull Request that is ready for review labels Sep 5, 2024
@mbertrand mbertrand added Needs Review An open Pull Request that is ready for review and removed Work in Progress labels Sep 5, 2024
@abeglova abeglova self-assigned this Sep 5, 2024
Copy link
Contributor

@abeglova abeglova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mbertrand mbertrand merged commit 8cf99df into main Sep 6, 2024
This was referenced Sep 6, 2024
@rhysyngsun rhysyngsun deleted the mb/oll_etl_2nd_topic branch February 7, 2025 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Needs Review An open Pull Request that is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants