Pace Notes export private-export-20261021-1050

Pace Notes dataset export private-export-20261021-1050 (supersedes private-export-20261021-0829).

5,327,504 records, 34 cities, 298 city/year editions (Amsterdam 2020 excluded). Freeze 2026-10-21 10:46 America/New_York.

• CORE (pace-notes-CORE-20261021-1050.tar.gz): race records, weather, courses, sources, edition metadata, record flags, docs.
• FULL (pace-notes-FULL-20261021-1050.tar.gz, attached in two parts; see below): CORE plus features.parquet with cross-race runner identity and pacing/wall features for every record (MATCHING.md, FEATURE-FIELD-NOTES.md).
• Checksums: RELEASE-SHA256SUMS-20261021-1050.txt; per-file SHA256SUMS.txt and MANIFEST.json inside each archive.

Changes since 0829: Valencia 2025 sex from F category codes (7,356 rows; never from names); Chicago 2024 handcycle division flag (6 rows); Chicago 2025 start 07:35; Chicago 2007 course_shortened_suspect flag (1,734 rows, heat-closure re-routing); full features tier restored; README notes on multi-wave weather, Chicago 2005/2009 15 km gaps and Valencia 2025 re-ingest. Pending re-pulls: London 2021-2026, Stockholm 2025, Vienna 2022-2024, NYC 2008 official count, Amsterdam 2023 finish times. Full details in CHANGE-REPORT.md.

FULL is attached in two parts (pace-notes-FULL-20261021-1050.tar.gz.part-00 and .part-01). To restore and verify:

cat pace-notes-FULL-20261021-1050.tar.gz.part-00 pace-notes-FULL-20261021-1050.tar.gz.part-01 > pace-notes-FULL-20261021-1050.tar.gz
sha256sum -c --ignore-missing RELEASE-SHA256SUMS-20261021-1050.txt
tar xzf pace-notes-FULL-20261021-1050.tar.gz

The joined file's sha256 is 6df47d5538023003271a89c289332e964aa136e34b3770ecffd2e704cc8490e5.

Pace Notes export 20261021-0829 (CORE+FULL)

Pace Notes export private-export-20261021-0829. Supersedes private-export-20260912-0934. Includes runner names as published by public timing sites.

• 5,327,504 records · 34 cities · 298 editions (Amsterdam 2020 virtual edition excluded)
• Snapshot sqlite sha256 92d939297382dec0236227bff751625f6cfbbff6a773ac79f029c9ce8c0fdd5a
• Assets: pace-notes-CORE-20261021-0829.tar.gz (CORE), pace-notes-FULL-20261021-0829.tar.gz (CORE + features), RELEASE-SHA256SUMS-20261021-0829.txt

CHANGE-REPORT: private-export-20261021-0829 vs private-export-20260912-0934

Both sides compared by race_records.id (canonical id). The 0934 side is the published 0934 race_records.parquet (4,462,379 rows; not modified).

	0934	20261021-0829	change
race_records	4,462,379	5,327,504	+865,125
editions (city, year)	256	298	+42 net (43 added, 1 excluded)
ids removed			117,081
ids added			982,206
same id, values changed			242,647
same id, unchanged			4,102,651

Snapshot: snapshot.sqlite sha256 92d939297382dec0236227bff751625f6cfbbff6a773ac79f029c9ce8c0fdd5a (VACUUM INTO of the platform DB after ingest finished, 2026-10-21 08:29 ET; DB 5,328,298 rows, 299 editions, 429 sources).

1. Corrections to data in 0934

Chicago 2018 and 2019: removed and re-ingested

In 0934 these editions (51,967 and 51,807 rows) were copies of Chicago 2024 (year bleed). All 103,774 rows were deleted on 2026-10-10 (with backups) and the real results were re-ingested: 2018 has 44,550 rows (44,549 finishes vs 44,584 official, -0.08%), and 2019 has 45,864 (vs 45,956, -0.20%). Both are complete within 0.5%. Every 0934 id for these years is gone; the new rows have new ids.

Frankfurt 2019 (wrong-year fix)

All 12,513 Frankfurt 2019 rows in 0934 came from the 2025 race (same mika event under every year path; the real 2019 winners were absent). They were deleted on 2026-10-08 after a backup. The real 2019 race was re-ingested with 10,554 rows (winners verified). Frankfurt 2018 and 2023-2025 were ingested from the correct events.

Paris 2014-2018: split de-accumulation

The 0934 split columns held running sums of segment times. 203,026 rows were corrected (1,418,020 split cells), and 1,889 rows that could not be corrected were left alone and flagged. Values changed for the same ids: 2014 38,481; 2015 39,652; 2016 41,358; 2017 41,593; 2018 41,942. The originals are kept in DQ backups. record_flags.splits_corrected is 1 for corrected rows and 0 for rows left alone.

Valencia 2022-2024: sex from category

15,702 rows had a blank sex although their category starts with F-. They now have sex = F (2022: 4,178; 2023: 5,342; 2024: 6,182) and are flagged sex_fixed_from_category = 1. No sex value was ever inferred from a name.

Honolulu 2021-2024: DNF split stored as the finish

2,124 rows hold an earlier split in split_42_2km, not a real finish. Raw values are unchanged. These rows are flagged dnf_split_as_finish = 1; exclude them from finish-time analyses.

Warsaw relabel

• Warsaw 2015-2018 (23,919 rows): race changed from "Warsaw Marathon" to "Orlen Warsaw Marathon". These rows are the spring Orlen race. Winners were verified, and weather was moved to the April race days.
• Warsaw 2019-2026 rows are the autumn PZU / Nationale-Nederlanden Warsaw Marathon. The Warsaw course profile applies from 2019 only.
• Vienna 2024: 42 rows relabelled to "Vienna City Marathon".

Helsinki 2024 and 2025: start time

The stored start of 15:00 belonged to the half marathon. The marathon start is 09:40, per the official traffic bulletin. Weather scalars now come from the 10:00 hour.

2. Weather (race_conditions)

Every edition in the release has a race_conditions row: 298 of 298. Amsterdam 2020 is excluded. Rows also carry new columns:

• source_kind: modelled (Open-Meteo archive).
• Nearest ISD station id, name and distance.
• exposure_window_start_local to _end_local: from the actual start (wave 1 where documented) to +6 h.
• Window aggregates: temp_c_win_mean/_max, dewpoint_c_win_mean, humidity_win_mean, wind_kmh_win_mean, precip_mm_win_sum.

On 2026-10-21, 23 rows written after the earlier fill were completed by the same method: Chicago 2005-2014 and 2026, Cologne 2026, Oslo 2026, Eindhoven 2025 and 2026, Warsaw 2019-2025, Valencia 2025.

3. Courses

• Berlin, Madrid and Paris profiles rescaled to 42.195 km.
• A Vienna profile was added from the official 2026 GPX.
• The Washington course display name is now "Marine Corps Marathon". race_records.race keeps "Washington Marathon" because it is part of the key.
• Known gaps: Melbourne has no sourced profile, and the Marine Corps profile is 42.863 km (668 m long) and needs re-sourcing.

4. New per-record and per-edition metadata

• record_flags.parquet (sparse; join on record_id = race_records.id) has these fields:

  • division (wheelchair_or_handcycle, elite or suspect_sub2; never guessed)
  • split_nonmonotonic, last_split_after_finish, pace_implausible
  • shifted_mat (Madrid 2023 25k, Auckland 2017 30k)
  • age_is_group_floor, dnf_split_as_finish, sex_fixed_from_category, splits_corrected, note

  On 2026-10-21, 8,099 rows ingested after 2026-10-10 were flagged with the same rules.

• edition_meta.parquet: one row per edition with the official finisher count, its source URL, the date checked, the DB count and a completeness status at 0.5% tolerance, plus a reason when partial.

• EDITIONS.json / EDITION-CHECKSUMS.csv: per-edition row counts and a sha256 of the edition's rows. The rows are ordered by id and serialized as one compact JSON array per line.

Full change report (added editions, count changes, hold editions, completeness) is in CHANGE-REPORT.md inside each tarball.

Superseded by private-export-20261021-1050 (2026-10-21; Figshare v3, DOI 10.6084/m9.figshare.33965155.v3).

HTW DB release 2026-10-16 16:52 ET (CORE+FULL, names included)

Includes runner names. Snapshot of the live HTW platform DB taken 2026-10-16 16:52 ET (SQLite backup API, writers kept running; integrity_check=ok). Same CORE/FULL format as private-export-20260912-0934 (which is unchanged).

• Records: 4,915,355 (+452,976 vs 0934) · 34 cities · 287 editions (31 added, 7 changed, 0 removed)
• max(ingested_at) 2026-10-16T20:51:53Z · id range 3601–5339920
• Chicago 2015 was mid-ingest at snapshot time (27,186 rows, partial).
• No strict 5K filter: rows with a finish time but no 5K split are included.

Assets: htw-db-CORE-20261016-1652.tar.gz (race_records, race_conditions, course_profiles, course_segments, sources parquet + races_summary/EDITIONS/CHANGE-REPORT/MANIFEST/README/SHA256SUMS/ID-CONTRACT) · htw-db-FULL-20261016-1652.tar.gz (CORE + features.parquet) · loose files · frozen SQLite (_snapshot_platform_20261016-1652-freeze.sqlite.gz). Checksums in RELEASE-SHA256SUMS-20261016-1652.txt. Per-edition counts in EDITIONS.json; diffs vs 0934 in CHANGE-REPORT.md.

HTW DB backup 2026-10-08 (pre Frankfurt wrong-year cleanup)

Consistent snapshot (VACUUM INTO) of live HTW platform.sqlite taken 2026-10-08 10:24 ET, before removing Frankfurt 2019/2023 rows that are really 2025 runners.
Records (race_records): 4546928
integrity_check: ok
Source: /workspace/race-data-platform/data/platform.sqlite (left in place; writers unaffected).
Asset: htw-platform-pre-ffm-cleanup-2026-10-08.sqlite.gz
sha256(.gz): 1a25f363e1a5b2c7dec454969c01cdc2fb2c570728532acf6fecf9ab145a8dbd
sha256(.sqlite): 56cbfec0749e61f8391c76c161ebf6fc30e995e6500967d988fe52492bba458a

HTW DB backup 2026-09-28

Daily off-machine backup of live HTW platform.sqlite (2026-09-28 America/New_York).
Records: 4536961
Source: /workspace/race-data-platform/data/platform.sqlite (left in place; writers unaffected).
Asset: htw-platform-backup-2026-09-28.sqlite.gz

HTW DB backup 2026-09-27

Daily off-machine snapshot of platform.sqlite (live ingest untouched).
Records: 4536961 · sources: 402 · gzip ~514M
Tag date: 2026-09-27 (America/New_York). Live DB left in place.
Note: 127.0.0.1:8787 /health timed out during this backup (uvicorn process present).

HTW DB backup 2026-09-26

Daily off-machine snapshot of platform.sqlite (live ingest untouched).
Records: 4,536,961 · sources: 402 · gzip ~514 MiB
Tag date: 2026-09-26 (America/New_York). Live DB left in place.

HTW live DB backup 2026-09-25

Daily off-machine snapshot of live platform.sqlite (America/New_York).
Records: 4,536,961
API health as_of: 2026-09-23T00:17:46Z
Asset: htw-db-2026-09-25.sqlite.gz

HTW live DB backup 2026-09-24

Off-machine snapshot of live HTW platform.sqlite (America/New_York date).

• race_records: 4,536,961
• gzip size: ~514M
• Note: API health check on 127.0.0.1:8787 timed out at backup time; file snapshot succeeded.

HTW DB backup 2026-09-23

Daily off-machine backup of live HTW platform.sqlite (America/New_York).

• Date (America/New_York): 2026-09-23
• Source: /workspace/race-data-platform/data/platform.sqlite
• Records: 4,533,961
• Sources: 402
• Health: ok on 127.0.0.1:8787 (as_of 2026-09-17T23:30:58Z)
• Artifact: htw-db-2026-09-23.sqlite.gz