Skip to content

1.0.4 — date corrections

Choose a tag to compare

View all tags
@juangomezcruces juangomezcruces released this 24 Aug 16:56
· 11 commits to main since this release
1.0.4
216f30c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

1.0.3 plus three corrected dates. This is the first release with no remaining executive findings.

If you are coming from 1.0.0, read the 1.0.1 notes first — everything they describe applies here, in particular that row counts are 82.8% lower because that is how many rows were exact duplicates.

What changed since 1.0.3

Three documents carried the wrong year. Each was credited to an executive who had not yet taken office, and in each case checking the document showed the executive was right and the date was wrong:

country was now what the document says
Chile 2022-01-07 2023-01-07 Marcela Ríos' resignation as Justice Minister and Luis Cordero's appointment — January 2023
Brazil 2016-02-07 2017-02-07 Lunch for President Macri at Itamaraty; his first official visit to Brasília was February 2017
Brazil 2016-01-24 2017-01-24 MCTI advisory council with minister Gilberto Kassab; that ministry was created in May 2016

year_of_statement moves with the date. Michel Temer's rows now begin 2016-05-12 and Gabriel Boric's 2022-03-11 — their actual inaugurations.

Nothing else differs from 1.0.3: 2,891,622 rows, 42 countries, full_ecd.parquet reconciling exactly.

Where executive now stands

Every finding against it is resolved:

  • the Obama/Trump handover, corrected in 1.0.3 — 23,255 rows returned to Obama
  • Italy's composite values, split in 1.0.3 — no executive anywhere packs two people
  • nine misspelled names, corrected in 1.0.2
  • the three dates above

The fifteen "overlapping terms" reported against 1.0.0 are also accounted for: twelve were an artefact of the validator comparing date spans rather than counting documents, and Gerald R. Ford's rows running to 1996 are 14 convention speeches, correctly attributed. See #13.

Still broken

ecd_validate.py reports 0 CRITICAL, 3 ERROR, against 19 CRITICAL and 55 ERROR in 1.0.0. All three need the source data back or a decision about what a column means, and none can be repaired from the published files:

  • #18 — Colombia is sourced entirely from YouTube.
  • #20 — type holds president names in the US file.
  • #19/#22 — url is null for Russia, whose text is the English kremlin.ru edition rather than the Russian original. file and office remain empty everywhere.

Also unchanged: the paragraph-vs-document grain (#15), uneven coverage (#21, see COVERAGE.md), and 100 Venezuela rows that could not be re-decoded because a byte was lost at ingest (#16).

The scrapers that produced the duplication have now been fixed at source (#30, #31), so a future build should not reintroduce it.

Using it

install.packages('ecdata', repos = 'https://executive-communications-dataset.r-universe.dev')
load_ecd(country = 'United States of America', ecd_version = '1.0.4')
ec.load_ecd(country='United States of America', ecd_version='1.0.4')

Built with ecd_repair.py from the 1.0.0 assets. 1.0.0 through 1.0.3 remain published and unchanged.

Assets 45
Loading