Skip to content

Bronze Layer Ingest v1.0.0

Choose a tag to compare

View all tags
@Ermolz69 Ermolz69 released this 21 Apr 09:58
· 6 commits to master since this release
v1.0.0
5661a46

Bronze Layer Ingest

Release for the local bronze ingest homework.

What is included

  • Ingest script downloads public data for traffic, weather, alerts, and roads.
  • Data is stored locally only in the bronze layer under data/bronze.
  • Output is partitioned by domain, source, ingest_date, and hour.
  • Metadata includes the author surname: Yermolovych.
  • Weather ingest supports 10 major Ukrainian cities.
  • Bulk weather history mode is available via --weather-history-days N --bulk-only.
  • External API failures are handled gracefully, so one failed source does not stop the whole ingest run.

Bronze Layer Report

See the report here: Docs/Bronze Layer/README.md

Assets 2
Loading