#

spark-kafka-integration

Here are 12 public repositories matching this topic...

spider-123-eng / Spark

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

streaming consumer parquet kafka-producer spark-sql spark-kafka-integration spark-streaming-data spark-transformations spark-to-cassandra-connection spark-dataframes spark-joins spark-hive-context spark-jdbc-connection spark-with-mangodb spark-aggregations-using-dataframe spark-use-cases cassandra-installation spark-datadog spark-mangodb spark-catalog-api

Updated Nov 16, 2022
Scala

mayankrawat / CSVJoin

Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.

Updated Jul 1, 2022
Java

xuanbo / spark-programming

spark代码

spark spark-streaming spark-sql spark-kafka-integration

Updated Jun 21, 2022
Scala

zekeriyyaa / PySpark-Structured-Streaming-ROS-Kafka-ApacheSpark-Cassandra

A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafka, analyzed by Apache Spark and stored in Cassandra.

python apache-spark cqlsh python3 ros pyspark spark-streaming kafka-consumer data-analysis apache-kafka kafka-producer apache-cassandra structured-streaming spark-sql spark-kafka-integration spark-cassandra-connector spark-cassandra ros-noetic spark-kafka-connector

Updated Feb 6, 2022
Python

RooseveltAdvisors / spark_structured_streaming_demo

A Log Analytics demo based on Spark Structured Streaming + Kafka

kafka log-analysis spark spark-kafka-integration spark-structured-streaming

Updated Aug 8, 2019
Python

vchoudhari45 / spark-kafka-integration

spark-kafka-integration

kafka spark kafka-consumer apache-kafka spark-kafka-integration spark-streaming-kafka spark-kafka

Updated Mar 20, 2019
Scala

kthristov / cubos-olap

maven spark-kafka-integration spark-structured-streaming spark-cassandra

Updated Jan 4, 2019
Scala

Mehul9891 / SparkCassandraConnector

spark spark-kafka-integration spark-cassandra-connector spark-socket-connection

Updated May 20, 2018
Java

spektom / kafka-dumper

Dumps events stored in Kafka to any Hadoop supported file system using Spark Streaming

kafka apache-spark spark-streaming spark-kafka-integration spark-kafka

Updated May 14, 2018
Scala

akashsethi24 / Spark-Kafka-Example

Example for Data Reading from and Writing to from Kafka Topic using Apache Spark DataFrame and DataSet

kafka apache-spark spark-streaming kafka-streams spark-kafka-integration custom-kafka-serializer custom-kafka-deseriazer kafka-decoder kafka-encoder

Updated Oct 13, 2017
Scala

yucl80 / log-handle-tools

java scala spark spark-streaming apache-flink flink flink-elasticsearch2-connector spark-kafka-integration flink-examples flink-kafka

Updated Sep 7, 2017
Scala

Ashishkr007 / SparkKafkaIntegration

Apache Spark and Apache Kafka integration and Spark Analytics over DataFrame.

Updated Feb 18, 2017
Java

Improve this page

Add a description, image, and links to the spark-kafka-integration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the spark-kafka-integration topic, visit your repo's landing page and select "manage topics."