Skip to content

Commit

Permalink
Update comment to clarify circumstances under which shuffle operates …
Browse files Browse the repository at this point in the history
…on serialized records
  • Loading branch information
JoshRosen committed Jun 13, 2015
1 parent 269089a commit 07bb2c9
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ case class Exchange(
} else if (serializeMapOutputs && serializer.supportsRelocationOfSerializedObjects) {
// SPARK-4550 extended sort-based shuffle to serialize individual records prior to sorting
// them. This optimization is guarded by a feature-flag and is only applied in cases where
// shuffle dependency does not specify an ordering and the record serializer has certain
// shuffle dependency does not specify an aggregator and the record serializer has certain
// properties. If this optimization is enabled, we can safely avoid the copy.
//
// This optimization also applies to UnsafeShuffleManager (added in SPARK-7081).
Expand Down

0 comments on commit 07bb2c9

Please sign in to comment.