Skip to content

Commit

Permalink
Event Manifest Populator: remove part-* pattern (close #4081)
Browse files Browse the repository at this point in the history
  • Loading branch information
chuwy authored and benjben committed Jul 17, 2019
1 parent 2c6ee8f commit a9621d7
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ object BackpopulateJob {
val runs = getRuns(jobConfig)
runs.foreach { runId =>
println(s"Processing $runId")
val events = sc.textFile(s"s3a://${jobConfig.enrichedInBucket}run=$runId/part-*")
val events = sc.textFile(s"s3a://${jobConfig.enrichedInBucket}run=$runId/*")
events.map(lineToTriple).foreach { triple => store(triple, storage) }
}
}
Expand Down

0 comments on commit a9621d7

Please sign in to comment.