A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0
-
Updated
Aug 5, 2021 - Scala
#
spark-batch
Here are 7 public repositories matching this topic...
Design/Implement stream/batch architecture on NYC taxi data | #DE
-
Updated
Apr 29, 2021 - Scala
Java Application, uses Apache Spark, handles batch as well as streaming processing
-
Updated
Jan 22, 2021 - Java
Various data stream/batch process demo with Apache Scala Spark 🚀
docker
dockerfile
scala
twitter
spark
apache-spark
sbt
pipeline
stream-processing
sbt-plugin
spark-streaming
sbt-assembly
spark-sql
spark-dataframes
spark-batch
spark-rdd
-
Updated
Feb 28, 2020 - Scala
Build an end to end data application with Yelp review dataset. (data collect -> DB config -> data ETL -> data dashboard (analysis/ML)
docker
data-science
machine-learning
database
spark
etl
kaggle
yelp
business-intelligence
redash
data-processing
database-modeling
spark-batch
-
Updated
Dec 17, 2019 - Python
The Road Monitoring System is a real-time software application that utilizes big data technologies to monitor and analyze vehicular data on Tunisian roads. It provides insights into vehicle locations, movements, and real-time analytics. The system offers an effective solution for monitoring cars conditions and detecting potential issues promptly.
-
Updated
Jun 11, 2023 - Java
Learning batch processing with Pyspark Interface for Apache Spark
-
Updated
Mar 8, 2023 - Jupyter Notebook
Improve this page
Add a description, image, and links to the spark-batch topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the spark-batch topic, visit your repo's landing page and select "manage topics."