Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-2774] - Set preferred locations for reduce tasks #1697

Closed
wants to merge 6 commits into from
Closed

[SPARK-2774] - Set preferred locations for reduce tasks #1697

wants to merge 6 commits into from

Commits on Jul 31, 2014

  1. Set preferred locations for reduce tasks

    @shivaram
    shivaram committed Jul 31, 2014
    Configuration menu
    Copy the full SHA
    3fe76f7 View commit details
    Browse the repository at this point in the history

  2. Amortize traversing array by doing it once per RDD.

    @shivaram
    shivaram committed Jul 31, 2014
    Configuration menu
    Copy the full SHA
    f8390dd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/apache/spark into reducer… 

    …-locality
    @shivaram
    shivaram committed Jul 31, 2014
    Configuration menu
    Copy the full SHA
    6782dea View commit details
    Browse the repository at this point in the history

  4. Add a unit test that checks for reducer locality

    @shivaram
    shivaram committed Jul 31, 2014
    Configuration menu
    Copy the full SHA
    3666ff5 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2014

  1. Use Guava's Ordering.greatestOf to avoid sorting 

    Also add a unit test for ordering and address comments
    @shivaram
    shivaram committed Aug 1, 2014
    Configuration menu
    Copy the full SHA
    acf1a2b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/apache/spark into reducer… 

    …-locality

Conflicts:
	core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
    @shivaram
    shivaram committed Aug 1, 2014
    Configuration menu
    Copy the full SHA
    6193039 View commit details
    Browse the repository at this point in the history