Skip to content

Commit

Permalink
fixed ORDER BY unit test
Browse files Browse the repository at this point in the history
  • Loading branch information
julienledem committed Jul 13, 2012
1 parent 0658af2 commit 1a0c6fe
Showing 1 changed file with 0 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,6 @@ public RDD<Tuple> convert(List<RDD<Tuple>> predecessors, POSort sortOperator)
SparkUtil.getManifest(Tuple.class),
SparkUtil.getManifest(Object.class)
).sortByKey(true);
// problem
// result is sorted but mapping the output shuffles it ... :(
return sorted.mapPartitions(TO_VALUE_FUCTION, SparkUtil.getManifest(Tuple.class));
}

Expand Down

0 comments on commit 1a0c6fe

Please sign in to comment.