Skip to content

Gold Layer Metrics v1.2.0

Choose a tag to compare

View all tags
@Ermolz69 Ermolz69 released this 24 Apr 10:28
· 3 commits to master since this release
v1.2.0
85152d1

Gold Layer Metrics

Release for the local Gold Layer homework built from the prepared Silver CSV snapshot.

What is included

  • Notebook-first Gold Layer implementation using only data/gold/silver_df.csv as input.
  • Local normalization and validation of the Silver snapshot before Gold aggregation.
  • Five separate Gold metric datasets written locally under data/processed/gold/metrics/....
  • Output paths include schema_v=1 and randomized batch_id=<uuid>.
  • Metadata includes the author surname Yermolovych.
  • .repartition(8) is preserved before writing each Gold dataset.
  • Notebook proof-reading works on Windows without Spark local file re-read issues.

Gold Metrics

  • traffic_activity_daily
  • avg_speed_by_period
  • congestion_weather_daily
  • route_performance_daily
  • geo_hotspots_daily

Notebook

Open the Gold Layer notebook here: Gold Layer/gold_layer_metrics.ipynb

Assets 2
Loading