services	platforms	author
hdinsight	scala	blackmist

Use Spark Structured Streaming with Apache Spark and Kafka on HDInsight

This example contains a Jupyter notebook that demonstrates how to use Spark structured streaming with Kafka on HDInsight

Note: This example requires Spark 2.2.0, which is available in HDInsight 3.6. The Spark and Kafka clusters must also be in the same Azure Virtual Network. To create a resource group containing all the services needed for this example, use the resource manager template in the Use Spark Structured Streaming with Kafka document.

Contributing

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.