Edtech Engagement Analytics

A big-data project that leverages advanced analytics to enhance EdTech's email marketing campaigns, driving learner engagement and platform expansion.

• Introduction & Goals
• Project Architecture
• Tools and Technologies used
• Datasets
• Services used
  • Data Pipeline
  • Data Processing
  • Data Analytics
• Deployment Pipeline
• Dashboard
• Author: 👤 Parth Champaneria
• Show your support

Introduction & Goals

Main goals: The main goal of this project is to leverage Big Data technologies to analyze and derive actionable insights from the vast amount of data generated by Edtech's email marketing campaigns. By doing so, the project aims to enhance the effectiveness of their marketing efforts, optimize campaign strategies, and ultimately attract and engage more learners on their platform.

Project architecture

Tools

• Scala

  • For writing spark jobs

• Spark

  • For writing data processing batch jobs

• Intellij

  • IDE for development

• GCP

  • Cloud Platform for building and deploying the project

Datasets

• An application was developed to generate all the data required for the application such as marketing campaign data, user data, and more. The application can be accessed here

Data Model

• The figure below displays a star schema model, depicting the fact table and its accompanying dimensions, which contain all the information needed for marketing analysis.

Services used

Data Pipeline

• [GCP DataFlow]

  For scheduling Spark Jobs and writing ETL jobs

Data Processing

• [GCP DataProc]

  For running Spark Jobs

• [Amazon DynamoDB]

  For storing User session data

Data Analysis

• [Big Query]

  For executing SQL queries and data warehousing

Deployment Pipeline

• A CI/CD pipeline for continuous integration and deployment of the application

Dashboard

• TO BE ADDED

Author: 👤 Parth Champaneria

Show your support

Give a ⭐️ if this project helped you!