-
Notifications
You must be signed in to change notification settings - Fork 320
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to decode byte messages from Kafka #24
Comments
Hi, Did you figure it out how to get the byte messages from Kafka ? The ReceiverLauncher.launch returns the DStream or JavaDStream (for Java) , and you can call the getPayload on MessageAndMetadata object to get the byte array... Something like this .. val tmp_stream = ReceiverLauncher.launch(ssc, props, numberOfReceivers,StorageLevel.MEMORY_ONLY) //Lets convert the Array[Byte] to String |
Hi, Yes, I figured out few hours ago. I tried to delete the issue but I I did exactly as you said and used the payload. It is working fine. Thank you so much for creating this receiver, it helped me a lot! Best,
|
Hi, Not an issue. You can raise any issue/question . Its perfectly fine. Glad to know this receiver is useful to you .. |
hi @fzschornack I have created a JIRA to track the progress of contributing back this project to Apache Spark. https://issues.apache.org/jira/browse/SPARK-11045 This project is now presently in spark-packages and I believe this is the correct time to contribute it to Apache Spark Project and give better options to larger community around Kafka Connectivity for Spark Streaming. kindly Vote for this JIRA. |
Voted! |
thanks |
No description provided.
The text was updated successfully, but these errors were encountered: