data(cases-deaths): new tool to inject data from the WHO #2783
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
central issue: #2785
This PR aims to provide a new set of tools to keep updating our case and death data. In short, the idea is that the command tool
cowid jhu
is replaced bycowid casedeath
, which should serve the exact same purpose.This PR will not remove all
jhu
-related tools and cron jobs. These will continue to run in parallel as the new ones are implemented and improved. This way, we can smoothly transition.To this end, we need to:
cowid.cases_deaths
, with a similar structure ascowid.jhu
, that does the same things: Create the necessary files to update our Grapher dataset and our complete dataset (viacowid megafile
). We need:cowid.cases_deaths
to download, process and export the cases/deaths data.cowid.PATHS
.public/data/cases_deaths
, to store the output from the previous step.cowid casedeath
: This should replacecowid jhu
in the future.cowid casedeath
in ourautoupdate.sh
script, so the new files are generated daily and pushed to the repository.grapherupdate.sh
script, so that the Grapher dataset is updated daily.