Skip to content

Latest commit

 

History

History
21 lines (13 loc) · 1.33 KB

README.md

File metadata and controls

21 lines (13 loc) · 1.33 KB
Raw

Log Analysis 📈 with Spark Streaming 📺, ElasticSearch 📊 and Kibana 👀 :

This is an academic project which aims to create a data streaming pipeline using Spark Streaming, ElasticSearch and Kibana. The workflow consists of generating continuous log data in a log file. then process it using spark streaming, the output is stored with Elastic Search and visualized in a Dashboard using Kibana.

  • 🎯 We aim in this academic project to create a data streaming pipeline using Spark Streaming, ElasticSearch and Kibana.
  • 👍 The workflow consists of generating continuous log data in a log file. then process it using spark streaming, the output is stored with Elastic Search and visualized in a Dashboard using Kibana.
  • 💥 Here is a small tutorial to run the project on your own machine :

Project tutorial

This work has been done by : Snoussi Amine, Jawhar Mohammed , Labriji Saad and Me.