Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Commits on Apr 8, 2014
  1. @andyk
Commits on Sep 26, 2013
  1. @pwendell
  2. @rxin

    Redirect Spark github

    rxin authored
  3. @rxin

    Merge pull request #670 from jey/ec2-ssh-improvements

    rxin authored
    EC2 SSH improvements
  4. @rxin

    Merge pull request #930 from holdenk/master

    rxin authored
    Add mapPartitionsWithIndex
  5. @rxin

    Merge pull request #7 from wannabeast/memorystore-fixes

    rxin authored
    some minor fixes to MemoryStore
    
    This is a repeat of #5, moved to its own branch in my repo.
    
    This makes all updates to   on ; it skips on synchronizing the reads where it can get away with it.
  6. @pwendell

    Merge pull request #9 from rxin/limit

    pwendell authored
    Smarter take/limit implementation.
Commits on Sep 24, 2013
  1. @pwendell
  2. @pwendell
  3. @holdenk

    Fix formatting :)

    holdenk authored
Commits on Sep 23, 2013
  1. @rxin

    Merge remote-tracking branch 'pr/12'

    rxin authored
    Fix spacing so java.io.tmpdir doesn't run on with SPARK_JAVA_OPTS
  2. Fix spacing so that the java.io.tmpdir doesn't run on with SPARK_JAVA…

    Y.CORP.YAHOO.COM\tgraves authored
    …_OPTS
  3. @rxin
  4. @rxin
  5. @rxin
  6. @holdenk
Commits on Sep 22, 2013
  1. @rxin

    Merge pull request #928 from jerryshao/fairscheduler-refactor

    rxin authored
    Refactor FairSchedulableBuilder
  2. @jerryshao
  3. @jerryshao
  4. @jerryshao

    Refactor FairSchedulableBuilder:

    jerryshao authored
    1. Configuration can be read from classpath if not set explicitly.
    2. Add missing close handler.
  5. @rxin

    Merge pull request #937 from jerryshao/localProperties-fix

    rxin authored
    Fix PR926 local properties issues in Spark Streaming like scenarios
  6. @rxin

    Merge pull request #941 from ilikerps/master

    rxin authored
    Add "org.apache." prefix to packages in spark-class
  7. @rxin

    Merge pull request #940 from ankurdave/clear-port-properties-after-tests

    rxin authored
    After unit tests, clear port properties unconditionally
  8. @jerryshao
Commits on Sep 21, 2013
  1. @aarondav

    Add "org.apache." prefix to packages in spark-class

    aarondav authored
    Lacking this, the if/case statements never trigger on Spark 0.8.0+.
  2. @rxin
Commits on Sep 20, 2013
  1. @rxin
  2. @wannabeast

    Synchronize on "entries" the remaining update to "currentMemory".

    wannabeast authored
    Make "currentMemory" @volatile, so that it's reads in ensureFreeSpace() are atomic and up-to-date--i.e., currentMemory can't increase while putLock is held (though it could decrease, which would only help ensureFreeSpace()).
  3. @ankurdave

    After unit tests, clear port properties unconditionally

    ankurdave authored
    In MapOutputTrackerSuite, the "remote fetch" test sets spark.driver.port
    and spark.hostPort, assuming that they will be cleared by
    LocalSparkContext. However, the test never sets sc, so it remains null,
    causing LocalSparkContext to skip clearing these properties. Subsequent
    tests therefore fail with java.net.BindException: "Address already in
    use".
    
    This commit makes LocalSparkContext clear the properties even if sc is
    null.
Commits on Sep 19, 2013
  1. @pwendell

    Merge pull request #938 from ilikerps/master

    pwendell authored
    Fix issue with spark_ec2 seeing empty security groups
  2. @aarondav

    Fix issue with spark_ec2 seeing empty security groups

    aarondav authored
    Under unknown, but occasional, circumstances, reservation.groups is empty
    despite reservation.instances each having groups. This means that the
    spark_ec2 get_existing_clusters() method would fail to find any instances.
    To fix it, we simply use the instances' groups as the source of truth.
    
    Note that this is actually just a revival of PR #827, now that the issue
    has been reproduced.
Commits on Sep 18, 2013
  1. @jerryshao
Commits on Sep 16, 2013
  1. @rxin
Commits on Sep 15, 2013
  1. @pwendell

    Merge pull request #933 from jey/yarn-typo-fix

    pwendell authored
    Fix typo in Maven build docs
  2. @jey

    Fix typo in Maven build docs

    jey authored
Something went wrong with that request. Please try again.