Permalink
Commits on Apr 8, 2014
Commits on Sep 26, 2013
  1. Redirect Spark github

    rxin committed Sep 26, 2013
  2. Merge pull request #670 from jey/ec2-ssh-improvements

    rxin committed Sep 26, 2013
    EC2 SSH improvements
  3. Merge pull request #930 from holdenk/master

    rxin committed Sep 26, 2013
    Add mapPartitionsWithIndex
  4. Merge pull request #7 from wannabeast/memorystore-fixes

    rxin committed Sep 26, 2013
    some minor fixes to MemoryStore
    
    This is a repeat of #5, moved to its own branch in my repo.
    
    This makes all updates to   on ; it skips on synchronizing the reads where it can get away with it.
  5. Merge pull request #9 from rxin/limit

    pwendell committed Sep 26, 2013
    Smarter take/limit implementation.
Commits on Sep 24, 2013
  1. Update build version in master

    pwendell committed Sep 24, 2013
  2. Fix formatting :)

    holdenk committed Sep 24, 2013
Commits on Sep 23, 2013
  1. Merge remote-tracking branch 'pr/12'

    rxin committed Sep 23, 2013
    Fix spacing so java.io.tmpdir doesn't run on with SPARK_JAVA_OPTS
  2. Fix spacing so that the java.io.tmpdir doesn't run on with SPARK_JAVA…

    Y.CORP.YAHOO.COM\tgraves committed Sep 23, 2013
    …_OPTS
  3. Switch indent from 2 to 4 spaces

    holdenk committed Sep 23, 2013
Commits on Sep 22, 2013
  1. Merge pull request #928 from jerryshao/fairscheduler-refactor

    rxin committed Sep 22, 2013
    Refactor FairSchedulableBuilder
  2. Remove infix style and others

    jerryshao committed Sep 13, 2013
  3. Refactor FairSchedulableBuilder:

    jerryshao committed Sep 12, 2013
    1. Configuration can be read from classpath if not set explicitly.
    2. Add missing close handler.
  4. Merge pull request #937 from jerryshao/localProperties-fix

    rxin committed Sep 22, 2013
    Fix PR926 local properties issues in Spark Streaming like scenarios
  5. Merge pull request #941 from ilikerps/master

    rxin committed Sep 22, 2013
    Add "org.apache." prefix to packages in spark-class
  6. Merge pull request #940 from ankurdave/clear-port-properties-after-tests

    rxin committed Sep 22, 2013
    After unit tests, clear port properties unconditionally
Commits on Sep 21, 2013
  1. Add "org.apache." prefix to packages in spark-class

    aarondav committed Sep 21, 2013
    Lacking this, the if/case statements never trigger on Spark 0.8.0+.
  2. Smarter take/limit implementation.

    rxin committed Sep 21, 2013
Commits on Sep 20, 2013
  1. Synchronize on "entries" the remaining update to "currentMemory".

    wannabeast committed Sep 20, 2013
    Make "currentMemory" @volatile, so that it's reads in ensureFreeSpace() are atomic and up-to-date--i.e., currentMemory can't increase while putLock is held (though it could decrease, which would only help ensureFreeSpace()).
  2. After unit tests, clear port properties unconditionally

    ankurdave committed Sep 20, 2013
    In MapOutputTrackerSuite, the "remote fetch" test sets spark.driver.port
    and spark.hostPort, assuming that they will be cleared by
    LocalSparkContext. However, the test never sets sc, so it remains null,
    causing LocalSparkContext to skip clearing these properties. Subsequent
    tests therefore fail with java.net.BindException: "Address already in
    use".
    
    This commit makes LocalSparkContext clear the properties even if sc is
    null.
Commits on Sep 19, 2013
  1. Merge pull request #938 from ilikerps/master

    pwendell committed Sep 19, 2013
    Fix issue with spark_ec2 seeing empty security groups
  2. Fix issue with spark_ec2 seeing empty security groups

    aarondav committed Sep 19, 2013
    Under unknown, but occasional, circumstances, reservation.groups is empty
    despite reservation.instances each having groups. This means that the
    spark_ec2 get_existing_clusters() method would fail to find any instances.
    To fix it, we simply use the instances' groups as the source of truth.
    
    Note that this is actually just a revival of PR #827, now that the issue
    has been reproduced.
Commits on Sep 18, 2013
Commits on Sep 16, 2013
Commits on Sep 15, 2013
  1. Merge pull request #933 from jey/yarn-typo-fix

    pwendell committed Sep 15, 2013
    Fix typo in Maven build docs
  2. Fix typo in Maven build docs

    jey committed Sep 15, 2013