Skip to content

In this academic project, we aim to create a data streaming pipeline using Spark Streaming, ElasticSearch and Kibana.

Notifications You must be signed in to change notification settings

labrijisaad/Log-Analysis-with-Spark-Streaming-ElasticSearch-and-Kibana

 
 

Repository files navigation

Log Analysis 📈 with Spark Streaming 📺, ElasticSearch 📊 and Kibana 👀 :

  • 🎯 We aim in this academic project to create a data streaming pipeline using Spark Streaming, ElasticSearch and Kibana.
  • 👍 The workflow consists of generating continuous log data in a log file. then process it using spark streaming, the output is stored with Elastic Search and visualized in a Dashboard using Kibana.
  • 💥 Here is a small tutorial to run the project on your own machine :
  • 📫 Feel free to contact me (labrijisaad@gmail.com), or the collaborators if anything is wrong or if anything needs to be changed 😎!

About

In this academic project, we aim to create a data streaming pipeline using Spark Streaming, ElasticSearch and Kibana.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 59.3%
  • Python 31.3%
  • Shell 9.4%