Skip to content

Commit

Permalink
Removing blocking keyword so as to prevent a large number of threads …
Browse files Browse the repository at this point in the history
…being spawned (#362)
  • Loading branch information
skakker authored and akshayrai committed Apr 6, 2018
1 parent 25c07bb commit 638eb77
Showing 1 changed file with 1 addition and 1 deletion.
Expand Up @@ -62,7 +62,7 @@ class SparkLogClient(hadoopConfiguration: Configuration, sparkConf: SparkConf, e
val (eventLogPath, eventLogCodec) =
sparkUtils.pathAndCodecforEventLog(sparkConf, eventLogFileSystem, baseEventLogPath, appId, attemptId)

Future {
Future {
sparkUtils.withEventLog(eventLogFileSystem, eventLogPath, eventLogCodec)(findDerivedData(_))
}
}
Expand Down

0 comments on commit 638eb77

Please sign in to comment.