Congestion Network 2: Modify Daily aggregations to exclude filter

[chmnata]

No description provided.

[chmnata]

Removed the filter for 80% length, and added a column length_w_data with summed length of link_dir with data, also added a column valid which is boolean with whether the hr bin data has 80% or more link with data. I think adding this additional column is gonna make aggregation easier and more straight forward in the latter stages, so we don't forget to filter this column if we need to aggregate by segments in the future (also don't need to join to the segments table again to get segment length).
But valid seems to be an sql command (?) since the text turns into red 🤔 , not sure what else to name it however, @radumas ?

[chmnata]

Actually should the daily table's tt be just a sum of tt from link_dir? In the previous commit I converted that tt with segment's length but I feel this is not helpful for when we calculate corridor's tt 🤔 since technically we just want to use the sum of link_dir's tt and then convert that to corridor's tt based on corridor's length 🤔 🤔

[radumas]

you could call it is_valid.

Concerned about people misinterpreting the tt column if it's unadjusted but also makes sense for ease of aggregation to not be converting back and forth.

maybe link_dir_tt or partial_tt or unadjusted_tt

[chmnata]

Do you think we should keep one for adjusted tt and one for unadjusted unadjusted_tt ? 🤔

[radumas]

Was about to write suggesting that. :thinking-sunglasses: Great minds :meow_think: