You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
BQ has powerful functions that work with GEOGRAPHY data. I will need them to calculate the average wait time on a stop.
To use those functions, I need to convert raw latitude and longitude coordinates to BQ native Geography Point. In particular, I care about two tables: vehicle_position and stops. vehicle_position contains bus GPS coordinates + timestamp, stops contains the GPS coordinates of the stops.
The aim of this epic is to design DAGs that transform lat and lon columns in vehicle_position and stops tables to BQ Geography Point. Transformed data will be saved as new tables in the prod stage (together with not-transformed data). This aligns with the second column in the diagram from the data flow article - https://vmois.dev/data-flow-bigquery-miwaitway/. Later, using those prod tables, I will be able to calculate average wait time, etc.
The text was updated successfully, but these errors were encountered:
VMois
added
the
epic
Kinda like milestone. Collection of PRs, other issues, etc. related to a common topic
label
May 5, 2024
BQ has powerful functions that work with GEOGRAPHY data. I will need them to calculate the average wait time on a stop.
To use those functions, I need to convert raw latitude and longitude coordinates to BQ native Geography Point. In particular, I care about two tables: vehicle_position and stops. vehicle_position contains bus GPS coordinates + timestamp,
stops contains the GPS coordinates of the stops.
The aim of this epic is to design DAGs that transform lat and lon columns in vehicle_position and stops tables to BQ Geography Point. Transformed data will be saved as new tables in the prod stage (together with not-transformed data). This aligns with the second column in the diagram from the data flow article - https://vmois.dev/data-flow-bigquery-miwaitway/. Later, using those prod tables, I will be able to calculate average wait time, etc.
The text was updated successfully, but these errors were encountered: