You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I am Trying to Implement sparklens for streaming Application. I am able to do the same for spark Batch Application by adding below additional line in my batch application spark submit command.
now I am trying to do the same with my streaming Applications also and using --jars /path/to/spark-streaminglens_2.11-0.5.3.jar
this jar in spark-submit command. Can someone kindly suggest if is there any way to run the same without changing anything in code.
//all Imports
object StreamApp {
def main(args: Array[String]): Unit = {
//SparkSession With sparklens Properties
val spark = SparkSession
.builder()
.appName("SparkLence_With_Spark_Submit")
.getOrCreate()
// code for streaming Application
}
}
The text was updated successfully, but these errors were encountered:
Hi, I am Trying to Implement sparklens for streaming Application. I am able to do the same for spark Batch Application by adding below additional line in my batch application spark submit command.
--jars /home/sparklens-0.1.2-s_2.11.jar
--conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener
--conf spark.sparklens.reporting.disabled=true
Without Changing anything in code.
now I am trying to do the same with my streaming Applications also and using --jars /path/to/spark-streaminglens_2.11-0.5.3.jar
this jar in spark-submit command. Can someone kindly suggest if is there any way to run the same without changing anything in code.
//all Imports
object StreamApp {
def main(args: Array[String]): Unit = {
//SparkSession With sparklens Properties
val spark = SparkSession
.builder()
.appName("SparkLence_With_Spark_Submit")
.getOrCreate()
The text was updated successfully, but these errors were encountered: