You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello @enesusta,
Thank you for creating this, it'd probably help a lot of people.
Looking at your data structure and code, it looks like you have to do nested lookups for specific locations (in functions like GetVillagesOfCounty, GetVillagesOfTown), which is not ideal. I think we can discuss here and find a better way. Alternatives I can think of are:
Restructuring the JSON
We might have a different json structure that allows fast retrievals, but it would require extra tooling
Using SQLite and/or Parquet files
This would probably take the project to a completely different realm, but considering that the file PTT releases is changing often it should be simpler to work with the released file since we'd avoid the extra steps in your parser work. I think we can get pretty fast retrievals with indexing.
Any other thoughts from anyone?
The text was updated successfully, but these errors were encountered:
Hello @enesusta,
Thank you for creating this, it'd probably help a lot of people.
Looking at your data structure and code, it looks like you have to do nested lookups for specific locations (in functions like
GetVillagesOfCounty
,GetVillagesOfTown
), which is not ideal. I think we can discuss here and find a better way. Alternatives I can think of are:We might have a different json structure that allows fast retrievals, but it would require extra tooling
This would probably take the project to a completely different realm, but considering that the file PTT releases is changing often it should be simpler to work with the released file since we'd avoid the extra steps in your parser work. I think we can get pretty fast retrievals with indexing.
Any other thoughts from anyone?
The text was updated successfully, but these errors were encountered: