provide publication artifacts

[tomkralidis]

Currently, we have a GitHub Actions CI that uses pywcmp's bundle workflow to publish a first pass/working level JSON file of all topics.

There are a few issues with this workflow:

• centres should be bound to countries only (per create folders for topic-hierarchy #29 (comment))
• the list will explode as domain topics begin to populate
• this workflow should be part of this repository, not pywcmp. Note that there will be some relation to Determine publication approach in Codes Registry #26 (which in contrast would provide different inputs to codes.wmo.int)

Assigning to @antje-s and @josusky; additional help is welcome (cc @wmo-im/tt-wismd)

[antje-s]

When going through csv files exactly, I noticed that so far the mapping between the centres and the respective country is missing.
country.csv includes always centre-id as child value and centre-id.csv does not contain a column with an assignment to a country...

[yhonda21]

In addition, I wonder how this center ID is linked to the name of RSMCs?

[antje-s]

...maybe we can call a py-script from the action, which does the merge. A first suggestion for such a merge script I put to a new branch:
https://github.com/wmo-im/wis2-topic-hierarchy/blob/JSON_bundle/merge2json/mergeTopic.py
But so far it contains only a fixed number of levels and can certainly be improved by an experienced programmer.

[amilan17]

When going through csv files exactly, I noticed that so far the mapping between the centres and the respective country is missing. country.csv includes always centre-id as child value and centre-id.csv does not contain a column with an assignment to a country...

see #39

[tomkralidis]

TT-WISMD 2023-09-12:

• perhaps CSV files are enough? Do we need to articulate the relationships?

• one issue is the relationship between country and centre id

• authoritative vocabulary:

  • codes.wmo.int can be used as the authoritative place for uploads
    • follow similar WMDR workflow for TTL generation and upload

• For runtime validation/bundle:

  • https://schemas.wmo.int/wth/a/ (CSVs) with the same structure as working area on GitHub
  • zipfile download as well
  • centres can download and build out lookup
    • would be valuable to provide this lookup for centres
      • pywcmp would support lookups
        • needs updating to the above structure (move away from JSON bundle)

• codes.wmo.int authoritative for browsing

• schemas.wmo.int provides directory structure/zipfile

• links to be put forth in the guide (already mentioned in each specification)

ACTIONS:

• @josusky to test publication to codes.wmo.int (https://github.com/wmo-im/wmds) (@amilan17 will send info as required)

[hhaddouch]

ET-W2AT Washington 13-15 November 2023
the publication mechanism is agreed, and need to be implemented