Bigdata processing (Realtime ETL DataPipeline) using Avro Schema Registry, Spark, Kafka, HDFS, Hive, Scala, docker, spark-streaming
scala
kafka
big-data
spark
hive
avro
docker-image
spark-streaming
kafka-consumer
hdfs
parquet
kafka-producer
kafka-streams
kafka-broker
spark-sql
kafka-container
etl-pipeline
avro-schema-registry
-
Updated
Dec 20, 2021 - Scala