Thursday, June 20, 2019

Spark: Narrow and Wide Dependencies

Narrow Dependencies: Where each partition of the parent RDD is used by Atmost one partition of the child RDD

Wide Dependencies: (Requires Shuffle) where multiple child partitions may depend upon it


No comments:

Post a Comment