Send a number of partitions to sc.textFile calls #968

Closed
ryan-williams opened this Issue Mar 17, 2016 · 1 comment

Comments

Projects
None yet
2 participants
@ryan-williams
Member

ryan-williams commented Mar 17, 2016

Otherwise they default to 2 no matter what spark.default.parallelism is set to

@fnothaft

This comment has been minimized.

Show comment
Hide comment
@fnothaft

fnothaft Mar 24, 2016

Member

Resolved by 13e7346.

Member

fnothaft commented Mar 24, 2016

Resolved by 13e7346.

@fnothaft fnothaft closed this Mar 24, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment