Document siri_rt.log v1 (current version)

[cjer]

Documentation should include the following:

1. file format
2. all fields, with their names as they appear in SIRI response
3. Reference to relevant official documentation (preferably from MOT if exists)
4. the corresponding GTFS fields for relevant fields
5. how fields appear in splunk (names and format)
6. an example file in our git (include SIRI request and response example files too)

Anything else?
We also need to make a general decision about where to put this kind of documentation (wiki/ markdown in code repo / separate documentation website?)

[cjer]

For documentation purposes, since MOT tends to change their pages and not keep old versions, I archived their current versions in the Internet Archive (maybe we should do this periodically too)

• https://web.archive.org/web/20190421212552/https://www.gov.il/he/Departments/General/gtfs_general_transit_feed_specifications
• https://web.archive.org/web/20190421212755/https://www.gov.il/BlobFolder/generalpage/gtfs_general_transit_feed_specifications/he/GTFS%20-%20Developer%20Information26.2.19.pdf
• https://web.archive.org/web/20190421212334/https://www.gov.il/he/Departments/General/real_time_information_siri
• https://web.archive.org/web/20190421212730/https://www.gov.il/BlobFolder/generalpage/real_time_information_siri/he/siriSM.pdf
• https://web.archive.org/web/20190421212520/http://media.mot.gov.il/TAHAZ/examplesofbroadcastersrequestresponse.zip
• https://web.archive.org/web/20190421212456/https://www.gov.il/BlobFolder/generalpage/real_time_information_siri/he/LA-App.pdf
• https://web.archive.org/web/20190421212436/https://www.gov.il/BlobFolder/generalpage/real_time_information_siri/he/ICD-SM.pdf
• https://web.archive.org/web/20190421212414/https://www.gov.il/BlobFolder/generalpage/real_time_information_siri/he/siri-faq_1.pdf

[evyatark]

Also - where the files are located (or at least a reference to an issue/wiki page that describes where they are located.
Also - reference to some code that reads such file (preferably in both Java and Python)

[adiwaz]

I started working on this documentation issue.

Location: I have opened a wiki page to host the information: "Bus Real Time (SIRI) Data Documentation". If you have comments/ideas for where is the best place to have this info please share.

[adiwaz]

Update - I put a link in the work-in-progress SIRI documentation wiki page to the siri_retriever README that was written by @evyatark : https://github.com/hasadna/open-bus/tree/siri-doc/siri

[adiwaz]

@cjer @evyatark
I need your help with information about:
1. What are the raw results that siri retriever gets?
2. What are the stages between the raw answers and the Splunk table?

Feel free to write it here / link to where it is documented / fill it directly in the wiki page: https://github.com/hasadna/open-bus/wiki/Bus-Real-Time-%28SIRI%29-Data-Documentation.

Thanks!

[adiwaz]

Update: We decided that we will have The data flow documentation from MOT to our servers (both siri and gtfs) documented in wiki, and the actual variables will be documented in the relevant code that generates the data tables.
This issue is going to be reorganized to affect this decision.