Skip to content
This repository has been archived by the owner on May 27, 2020. It is now read-only.

Use the Direct Approach in Streaming-Kafka integration. #34

Open
mariomgal opened this issue Jul 2, 2015 · 1 comment
Open

Use the Direct Approach in Streaming-Kafka integration. #34

mariomgal opened this issue Jul 2, 2015 · 1 comment
Labels
enhancement

Comments

@mariomgal
Copy link
Contributor

Spark 1.3 introduced a new direct approach for integrating Kafka and Spark Streaming (without receivers). It has several advantages, as explained here:

https://spark.apache.org/docs/1.3.1/streaming-kafka-integration.html
@mariomgal
Copy link
Contributor Author

Take High Availability features into account, we will need to store Kafka status in Zookeeper.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mariomgal