Skip to content

Commit

Permalink
Tweak bulk loader config handling
Browse files Browse the repository at this point in the history
This is for compatibility with SparkGraphComputer.  In particular, I
seem to need the useGraphConfig method when executing on
SparkGraphComputer, even though it's not required on
GiraphGraphComputer.  I think {Spark,Giraph}GraphComputer may have
some kind of discrepancy in how they handle VP configs that bulk
loader is triggering (maybe bulk loader is doing something odd?)
  • Loading branch information
dalaro committed May 2, 2015
1 parent 61175c8 commit 1a86479
Showing 1 changed file with 7 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -57,8 +57,15 @@ private BulkLoaderVertexProgram() {

}

public BulkLoaderVertexProgram useGraphConfig(final Configuration c) {
this.configuration = c;
return this;
}

public void storeState(final Configuration configuration) {
VertexProgram.super.storeState(configuration);
if (this.configuration == null)
return;
this.configuration.getKeys().forEachRemaining(key -> {
configuration.setProperty(CFG_GRAPH_PREFIX + key, this.configuration.getProperty(key));
});
Expand Down

0 comments on commit 1a86479

Please sign in to comment.