Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

data(cases-deaths): new tool to inject data from the WHO #2783

Merged
merged 12 commits into from
Feb 20, 2023
Merged

Conversation

lucasrodes
Copy link
Member

@lucasrodes lucasrodes commented Feb 16, 2023

central issue: #2785


This PR aims to provide a new set of tools to keep updating our case and death data. In short, the idea is that the command tool cowid jhu is replaced by cowid casedeath, which should serve the exact same purpose.

This PR will not remove all jhu-related tools and cron jobs. These will continue to run in parallel as the new ones are implemented and improved. This way, we can smoothly transition.

To this end, we need to:

  • Add a new module cowid.cases_deaths, with a similar structure as cowid.jhu, that does the same things: Create the necessary files to update our Grapher dataset and our complete dataset (via cowid megafile). We need:
    • Code in cowid.cases_deaths to download, process and export the cases/deaths data.
    • Country standardisation JSON file.
    • New paths added to cowid.PATHS.
    • New timestamp.
  • Create a new directory public/data/cases_deaths, to store the output from the previous step.
  • Add a new command cowid casedeath: This should replace cowid jhu in the future.
  • Add the new methods to our cron jobs:
    • Call cowid casedeath in our autoupdate.sh script, so the new files are generated daily and pushed to the repository.
    • Add the appropriate command to our grapherupdate.sh script, so that the Grapher dataset is updated daily.

@lucasrodes lucasrodes self-assigned this Feb 16, 2023
@lucasrodes lucasrodes changed the title wip(cases-deaths): use who as source data(cases-deaths): new tool to inject data from the WHO Feb 17, 2023
@lucasrodes lucasrodes marked this pull request as ready for review February 17, 2023 15:35
@lucasrodes lucasrodes merged commit d6c4c11 into master Feb 20, 2023
@lucasrodes lucasrodes linked an issue Feb 21, 2023 that may be closed by this pull request
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cases and deaths: New source, technical details
1 participant