[GSoC 1.5 and 1.6]: Question regarding beam jobs

[Vir-8]

Hi, in the required skills of 1.5 and 1.6 - it is mentioned that writing apache beam jobs would be a plus but they aren't required, will these projects include writing beam jobs or similar? And mainly, how much would beam jobs be relevant to these projects?

[seanlip]

We expect that both projects can be done without Beam jobs, but they might prove useful:

• For 1.5, a robust way to do tracking of points etc. would be to store each event in an event log model, as well as updating the relevant counters. If the counter data gets corrupted then we can run a Beam job over the event log model to regenerate the counts.
• For 1.6, a possible approach is to maintain metadata about which translations exist for each state, rather than determining that info on the fly. If that approach is used then a Beam job will be needed to do initial population of that metadata.

I hope this helps!