Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-3376] Add experimental (non-production) in-memory shuffle option. #5403

Closed
wants to merge 3 commits into from
Closed

[SPARK-3376] Add experimental (non-production) in-memory shuffle option. #5403

wants to merge 3 commits into from

Commits on Apr 7, 2015

  1. [SPARK-3376] Add in-memory shuffle option. 

    With this change, in-memory shuffle data is cleaned up in the
same way as disk shuffle data: using the metadata cleaner. It
would probably be better to clean up in-memory shuffle data more
aggressively, in order to avoid running out of memory.
    @kayousterhout
    kayousterhout committed Apr 7, 2015
    Copy the full SHA
    293fd69 View commit details
    Browse the repository at this point in the history

  2. Added missing newlines

    @kayousterhout
    kayousterhout committed Apr 7, 2015
    Copy the full SHA
    57fb068 View commit details
    Browse the repository at this point in the history

  3. Fixed header

    @kayousterhout
    kayousterhout committed Apr 7, 2015
    Copy the full SHA
    00bdcd6 View commit details
    Browse the repository at this point in the history