Add field completeness script to Map UI #2297
Comments
joe-brilliant
added
P1: Launch blocker
joe-brilliant
assigned abhidg, iamleeg, jim-sheldon, Mougk, fojackson8, sergioloporto and marlenachroscicka
maciej-zarzeczny
moved this from To do
to In progress
in Global.health HTD Kanban Board
|
Please note the above CSV contains country completeness as calculated on 30/11/2021. |
|
Thanks @fojackson8 ! (see above @maciekz1996 ) |
maciej-zarzeczny
moved this from In progress
to Internal PR (With WIP Label)
in Global.health HTD Kanban Board
maciej-zarzeczny
moved this from Internal PR (With WIP Label)
to DONE
in Global.health HTD Kanban Board
maciej-zarzeczny
moved this from DONE
to PR- For acceptance from BCH
in Global.health HTD Kanban Board
|
Following up email threads/chats today, would be great to add the equivalent of a "freshness" field that shows the latest date of ingestion per country (cc @fojackson8 @maciekz1996 @abhidg @jim-sheldon @iamleeg @Mougk) |
|
Add completeness to aggregate code to generate JSON in covid-19-aggregates bucket |
marlenachroscicka
moved this from PR- For acceptance from BCH
to In progress
in Global.health HTD Kanban Board
Related: #2297 Format of the new metrics/completeness.json is as follows { "country1": { "field1": c1 "field2": c2 }, "country2": { ... } ... } where c1 and c2 are the completeness (as a percentage) of the respective fields.
Related: #2297 Format of the new metrics/completeness.json is as follows { "country1": { "field1": c1 "field2": c2 }, "country2": { ... } ... } where c1 and c2 are the completeness (as a percentage) of the respective fields.
Related: #2297 Format of the new metrics/completeness.json is as follows { "country1": { "field1": c1 "field2": c2 }, "country2": { ... } ... } where c1 and c2 are the completeness (as a percentage) of the respective fields.
|
@maciekz1996 Completeness data is at s3://covid-19-aggregates/metrics/completeness.json, let me know if you need any changes. The country labels will change to two letter codes once that migration is over. I have set the script to run weekly on Sundays. |
|
That's awesome thanks @abhidg! Does this also include "freshness"? |
maciej-zarzeczny
moved this from In progress
to Blockers
in Global.health HTD Kanban Board
|
@joe-brilliant freshness is at metrics/freshness.json updated daily |
maciej-zarzeczny
moved this from Blockers
to In progress
in Global.health HTD Kanban Board
maciej-zarzeczny
moved this from In progress
to Internal PR (With WIP Label)
in Global.health HTD Kanban Board
maciej-zarzeczny
moved this from Internal PR (With WIP Label)
to DONE
in Global.health HTD Kanban Board
Quick placeholder issue to incorporate @fojackson8's awesome new script to illustrate completeness % across all our db fields into our data viz when we roll out the new react rebuild for our map : ). This feature will help users get a snapshot of data completeness across our schema, which has been long requested
Will take some design thinking and tinkering but maybe it could live as an enhancement to our Coverage Map tab with some contextual options in the left-hand module to select different fields to view completeness by country.
@fojackson8 if you could add the CSV to this issue that would be great, thanks!
The text was updated successfully, but these errors were encountered: