Repository to demonstrate sample data engineering assignment

Using Scala for big data computations for basic tasks

This Spark App analyses various covid cases data and enables you to create custom mathematical insights using a unified data structure and a trait method. After processing data it then writes to Cassandra which is then used as primary source for Data Visualization.

Demo of spark program with cucumber framework using scala

Coursework from Functional Programming in Scala Coursera specialization.

This repository contains spark scala programs

Minimal project setup required to run applications on Spark

Demonstration of basic data transformations using Spark RDD and Spark DataFrame in Scala

Assignment for Scalable Machine Learning which aims to study the basics of regression and classification in Spark.

A Spark framework written in Scala with gradle as build tool.

This repository is created by Dharshan Kumar K S and Siva Prakash as part of our semester project from 'Big Data Analysis' subject

Lightweight type-safe operations for Spark

Spark BigQuery Parallel

Apache Spark Course Material

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.