It's all about A/B testing
It is a real time A/B testing platform that can perform A/B testing and calculate search click through rate for control and test groups in real time, using search data from Avito.com, which is one of biggest e-commerce website in Russia
It is a project done in insight data engineer program. In 3 weeks, I ingested log data using Kafka, stream processed data with Spark streaming, and stored aggregated data in MySQL database and created interactive live data visualization with Flask, Grafana and JavaScript