Skip to content

Narrow Transformation vs Wide Transformation

Jump to bottom Edit New page
Vaquar Khan edited this page Oct 18, 2017 · 1 revision

Narrow transformation – In Narrow transformation, all the elements that are required to compute the records in single partition live in the single partition of parent RDD. A limited subset of partition is used to calculate the result. Narrow transformations are the result of map(), filter()

Wide transformation – In wide transformation, all the elements that are required to compute the records in the single partition may live in many partitions of parent RDD. The partition may live in many partitions of parent RDD. Wide transformations are the result of groupbyKey() and reducebyKey().

http://data-flair.training/blogs/spark-rdd-operations-transformations-actions/

Add a custom footer
Add a custom sidebar
Clone this wiki locally