Skip to content
/ streaming_nd Public
forked from shabie/streaming_nd

Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions

0 stars 16 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

eshnil2000/streaming_nd

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

56 Commits
Actions in Spark
Actions in Spark
 
 
Aggregating Data with KSQL [7.5]
Aggregating Data with KSQL [7.5]
 
 
Build a Kafka Consumer [2.6]
Build a Kafka Consumer [2.6]
 
 
Complex Records in Avro [3.3]
Complex Records in Avro [3.3]
 
 
Configure a Producer [2.4]
Configure a Producer [2.4]
 
 
Consuming Avro Data via REST Proxy [4.7]
Consuming Avro Data via REST Proxy [4.7]
 
 
Create RDD and DataFrame
Create RDD and DataFrame
 
 
Creating a Stream with KSQL [7.1]
Creating a Stream with KSQL [7.1]
 
 
Creating a Table with KSQL [7.2]
Creating a Table with KSQL [7.2]
 
 
Data Streaming without Schemas [3.1]
Data Streaming without Schemas [3.1]
 
 
Data Wrangling with Spark
Data Wrangling with Spark
 
 
Defining an Avro Record [3.2]
Defining an Avro Record [3.2]
 
 
Deserialization in Faust [6.2]
Deserialization in Faust [6.2]
 
 
Establishing a Schema Spark Streaming
Establishing a Schema Spark Streaming
 
 
Example Spark SQL
Example Spark SQL
 
 
Explore How Kafka Works [2.1]
Explore How Kafka Works [2.1]
 
 
Hadoop MapReduce
Hadoop MapReduce
 
 
Hopping Windows [6.8]
Hopping Windows [6.8]
 
 
Integrating Schema Registry [3.4]
Integrating Schema Registry [3.4]
 
 
Kafka Connect FileStream Source [4.2]
Kafka Connect FileStream Source [4.2]
 
 
Kafka Connect JDBC Source [4.3]
Kafka Connect JDBC Source [4.3]
 
 
Kafka Python Library [1.2]
Kafka Python Library [1.2]
 
 
Output Sinks
Output Sinks
 
 
Practice with Consumer Offsets [2.5]
Practice with Consumer Offsets [2.5]
 
 
Procedural vs Functional in Python
Procedural vs Functional in Python
 
 
Processors & Operations [6.5]
Processors & Operations [6.5]
 
 
Producing Avro Data via REST Proxy [4.6]
Producing Avro Data via REST Proxy [4.6]
 
 
Producing JSON Data via REST Proxy [4.5]
Producing JSON Data via REST Proxy [4.5]
 
 
Project - Optimizing Public Transportation
Project - Optimizing Public Transportation
 
 
Project - SF Crime Statistics with Spark Streaming
Project - SF Crime Statistics with Spark Streaming
 
 
Querying with KSQL [7.3]
Querying with KSQL [7.3]
 
 
Quiz - Data Wrangling with DataFrames
Quiz - Data Wrangling with DataFrames
 
 
Quiz - Data Wrangling with SparkSQL
Quiz - Data Wrangling with SparkSQL
 
 
REST Proxy Metadata API [4.4]
REST Proxy Metadata API [4.4]
 
 
Reading and Writing Data with Spark DataFrames
Reading and Writing Data with Spark DataFrames
 
 
Serialization in Faust [6.3]
Serialization in Faust [6.3]
 
 
Session Windowing with KSQL [7.4]
Session Windowing with KSQL [7.4]
 
 
Spark maps and lazy evaluation
Spark maps and lazy evaluation
 
 
State Management Spark Streaming
State Management Spark Streaming
 
 
Streaming - Create a Kafka Producer Server [Incomplete]
Streaming - Create a Kafka Producer Server [Incomplete]
 
 
Streaming - Kafka Data Source API [Incomplete]
Streaming - Kafka Data Source API [Incomplete]
 
 
Streaming - Offsets & Triggers [Incomplete]
Streaming - Offsets & Triggers [Incomplete]
 
 
Streaming - Progress Reports in Spark Console [Incomplete]
Streaming - Progress Reports in Spark Console [Incomplete]
 
 
Streams [6.4]
Streams [6.4]
 
 
Structured Streaming APIs Joins
Structured Streaming APIs Joins
 
 
Synchronous or Asynchronous [2.3]
Synchronous or Asynchronous [2.3]
 
 
Tables in Faust [6.6]
Tables in Faust [6.6]
 
 
Topic Creation [2.2]
Topic Creation [2.2]
 
 
Transformations in DAGs
Transformations in DAGs
 
 
Transformations in Spark
Transformations in Spark
 
 
Tumbling Windows [6.7]
Tumbling Windows [6.7]
 
 
Using Kafka CLI Tools [1.1]
Using Kafka CLI Tools [1.1]
 
 
Using the Kafka Connect API [4.1]
Using the Kafka Connect API [4.1]
 
 
Watermark Spark Streaming
Watermark Spark Streaming
 
 
Your First Faust Application [6.1]
Your First Faust Application [6.1]
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 
requirements.txt
requirements.txt
 
 

Repository files navigation

Data Streaming Nanodegree

Data Streaming Nanodegree by Udacity Notes and Exercises

Notes on usage

  1. Many of the files called "solution" are done for streamed based on ClickEvents. Once marked "solved" are done for some part with the examples of Purchases events as in the video, but later also with ClickEvents.

About

Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions

Topics

udacity nanodegree data-streaming

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Python 58.3%
  • Jupyter Notebook 36.1%
  • Shell 5.1%
  • HTML 0.5%