Skip to content

Conversation

tiffanychu90
Copy link
Member

@tiffanychu90 tiffanychu90 commented Feb 6, 2024

  • Jot down thoughts around issues to solve in rt_vs_schedule route-direction aggregation in route_aggregation.ipynb
  • Add config.yml for rt_vs_schedule to show sub-folders within GCS
  • Remove vp_spatial_accuracy script, now done with rt_v_scheduled_trip script
  • Create long dfs with columns similar to what's outlined in Epic - GTFS Digest (exploratory portfolio) #989
  • TODO: move shared_utils.utils_to_add to calitp_data_analysis --> fix parsing away of directory in utils.geoparquet_gcs_export

Main issues to address

  1. Keep source data + metrics tightly defined with GCS bucket organization.
    vp_usable is source data for rt_vs_sched metrics, do not merge in schedule data until gtfs_digest report. Only bring in schedule_gtfs_dataset_key column in vp_usable + route_id-direction_id for trips also present in schedule. If not in schedule, fill it with route_id = Unknown and direction_id as Int64
  2. Add function to concatenate trip file, enable us to put in 1 day or 7 days for aggregation
  3. A single function for normalized metrics (percent, per min, etc)
  4. A single function for aggregation (summing up numerator / denominator)

Copy link

github-actions bot commented Feb 6, 2024

nbviewer URLs for impacted notebooks:

2 similar comments
Copy link

github-actions bot commented Feb 6, 2024

nbviewer URLs for impacted notebooks:

Copy link

github-actions bot commented Feb 6, 2024

nbviewer URLs for impacted notebooks:

@tiffanychu90 tiffanychu90 force-pushed the rt-sched-route-aggregation branch from a9dc76a to 65853de Compare February 6, 2024 20:11
@tiffanychu90 tiffanychu90 merged commit a7a448d into main Feb 6, 2024
@tiffanychu90 tiffanychu90 deleted the rt-sched-route-aggregation branch February 6, 2024 22:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant