Worked on Pyspark file streaming

Utilizing Apache Spark & PySpark to analyze a movie dataset. Tasks include data exploration, identifying top-rated movies, training a linear regression model, and experimenting with Airflow.

PySpark House Price Prediction features a PySpark-based Linear Regression model for predicting median house prices. It showcases data preprocessing, model training, and evaluation, yielding an RMSE of around 0.11. The code offers insights into building robust predictive models using PySpark.

Project based on application of azure databricks

This notebook contains the usage of Pyspark to build machine learning classifiers (note that almost ml_algorithm supported by Pyspark are used in this notebook)

Problems on Hadoop-MapReduce, Hive and PySparkSQL

📈📊 Big Data Notebooks . ▫️ Análisis masivos de datos con pyspark ▫️ Ingesta de datos. ▫️ Algoritmos de machine learning con datos masivos. ▫️ Procesamiento de mensajes en tiempo real con Kafka.

twitter real-time sentiment analysis

Creates a ML Pipeline leveraging PySpark SQL and PySpark MLib to predict sound level

This notebook performs EDA over a movie ratings dataset via pyspark sql.

This script builds a linear regression model using PySpark to predict student admissions at Unicorn University.

This is a Big Data project using AWS, pyspark-sql, pyspark and Google Collaboratory to determine if there is any bias in the reviews of vine and non-vine reviewers on Amazon.

Data analysis project with Pyspark on Jupyter Notebook

Inventory value is also important for determining a company's liquidity, or its ability to meet its short-term financial obligations. A high inventory value can indicate that a company has too much money tied up in inventory, which could make it difficult for the company to pay its bills.

Clustering vs Classification

Big data management with PySpark

Nifi - Kafka - Pyspark merupakan sarana belajar saya untuk mengeksplorasi lebih dalam terkait penggunaan tools tersebut

The notebook shows how tools of the PySpark SQL module work in practice.

PySpark ML Heart and Advertisement Data Analysis