An investigatory analysis of restaurant sales data using Apache Spark in an attempt to give some insights as to how to boost up the sales of less frequently sold items. This is a real-world dataset from an actual restaurant.

Exploring World Development Indicators: Identifying relationship between Health Indicators using Linear Regression & Classification of Income Group based on Health Indicators using Logistic Regression.

This is a PolyU COMP 4442 project to design a web service based on Spark SQL.

Created a SparkML RandomForest model to predict total employee compensation. Queried data with SparkSQL, ran PySpark scripts to run EDA, pre-process data, and train model achieving with 0.98 R2 score.

Analysis of a dataset of flights, using the SparkSQL framework and extra web scraping techniques

These are some code examples

This project will show an auto-updated map with the people interaction during COVID19 in the US using big data technologies to analysis a real-time stream of Twitter data.

IOT Sensors RealTime Analysis with Apache Spark, Kafka, Python and SQL.

Spark Notes

Explanatory Data Analysis and ML model building using Apache Spark and PySpark

Big Data Analytics for anazon.com using Spark Framework and Scala Programming Language

Music prediction using PySpark

Sample analysis done using pyspark on parking violations issued for fiscal year 2017 using the databricks platform

End-to-end real-time credit card transactions application. Made with Kafka, Spark, Bootstrap, ECharts, RxJS.

Recommendation System written in Python, using the pySpark framework and other Data Science libraries

Ralph Winters Website

This project extracts list, information and statistics from Wikipedia articles of current and past NBA players. I used Spark SQL to extract information from html documents and save it to a csv file. In the nearby future, I will post the same objective achieved using Pig