Skip to content
#

spark-streaming

Star

Here are 271 public repositories matching this topic...

Language: Python
Filter by language
All 1,039 Scala 279 Python 271 Java 168 Jupyter Notebook 146 Shell 23 HTML 21 JavaScript 17 XSLT 14 CSS 9 C# 5
Sort: Most forks
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
ApacheSpark

martandsingh / ApacheSpark

Star 88

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.

sql database spark hive hadoop etl pyspark data-engineering spark-streaming data-analysis databricks datalake spark-sql timetravel apachespark etl-pipeline deltalake
  • Updated Dec 28, 2023
  • Python

databrickslabs / dbldatagen

Star 291

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

python spark faker pyspark spark-streaming data-generation databricks synthetic-data datagen datagenerator deltalake datageneration delta-live-tables
  • Updated Jul 25, 2024
  • Python

vaibhavmagon / Kafka-Spark-Product-Recommendation

Star 13

Python script demonstrating spark streaming and Kafka implementation using an e-commerce website like product recommendation engine based on item-based collaborative filtering. 🐍. 💥

data machine-learning kafka spark topic zookeeper python3 collaborative-filtering spark-streaming recommendation-system kafka-consumer kafka-producer hacktoberfest kafka-server hacktoberfest-accepted hacktoberfest2021
  • Updated Oct 21, 2021
  • Python

samerelhousseini / Geospatial-Analysis-With-Spark

Star 16

This is a data processing pipeline that implements an End-to-End Real-Time Geospatial Analytics and Visualization multi-component full-stack solution, using Apache Spark Structured Streaming, Apache Kafka, MongoDB Change Streams, Node.js, React, Uber's Deck.gl and React-Vis, and using the Massachusetts Bay Transportation Authority's (MBTA) APIs …

react nodejs kafka spark mongodb spark-streaming spark-sql deckgl react-vis
  • Updated Dec 11, 2022
  • Python

Improve this page

Add a description, image, and links to the spark-streaming topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the spark-streaming topic, visit your repo's landing page and select "manage topics."

Learn more