Skip to content

Commit

Permalink
WarningParseMode.IGNORE
Browse files Browse the repository at this point in the history
  • Loading branch information
carstendraschner committed Feb 16, 2021
1 parent d42091b commit fc50c00
Showing 1 changed file with 2 additions and 2 deletions.
Expand Up @@ -38,7 +38,7 @@ object LMDB_Pipeline {
spark,
inputFilePath,
stopOnBadTerm = ErrorParseMode.SKIP,
stopOnWarnings = WarningParseMode.SKIP
stopOnWarnings = WarningParseMode.IGNORE
).toDS().cache()
println(f"READ IN DATA:\ndata consists of ${dataset.count()} triples")
dataset.take(n = 10).foreach(println(_))
Expand All @@ -47,7 +47,7 @@ object LMDB_Pipeline {
spark,
inputFilePath,
stopOnBadTerm = ErrorParseMode.SKIP,
stopOnWarnings = WarningParseMode.SKIP
stopOnWarnings = WarningParseMode.IGNORE
).toDF.toDF(Seq("s", "p", "o"): _*).cache() // .toDF(Seq("s", "p", "o"): _*)
df.show(false)
// val df = dataset.rdd.toDF()
Expand Down

0 comments on commit fc50c00

Please sign in to comment.