💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算);🚀 支持运行过程中增删topic;🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
-
Updated
Apr 15, 2021 - Scala
💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算);🚀 支持运行过程中增删topic;🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)
💥 👽 ♨️🚀Encapsulated spark 与其他组件的结合api,方便使用,例如 es,hbase,kudu,kafka,mq等
Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.
NYC Taxi & Limousine Commission's open data with Spark Streaming 3.0.0
This is a onestopshop for all spark streaming and spark batch integrations with other hadoop ecosystem projects
spark-kafka-integration
Dumps events stored in Kafka to any Hadoop supported file system using Spark Streaming
This code just loads data to kafka through apache spark and reads it back.
Add a description, image, and links to the spark-kafka topic page so that developers can more easily learn about it.
To associate your repository with the spark-kafka topic, visit your repo's landing page and select "manage topics."