Notes about Spark Streaming in Apache Spark

This repository contains the steps to install Apache Spark, and run an application that consumes the twitter's real-time stream, performs transformations on the data and displays them on a real-time dashboard in Jupyter Notebook.

A repository for ipython notebook backup

Spark Course notebooks.

Repository of notebooks and related collateral used in the Databricks Demo Hub, showing how to use Databricks, Delta Lake, MLflow, and more.

Jupyter notebooks for filtering Kafka data with Spark Streaming.

This repo contains my learnings and practice notebooks on Spark using PySpark (Python Language API on Spark). All the notebooks in the repo can be used as template code for most of the ML algorithms and can be built upon it for more complex problems.

Big Data Management related Zeppelin notebooks

This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a live demo of a movie recommendation web application you can interact with. The demo also uses IBM Message Hub (kafka) to push application events to…