Permalink
Commits on Apr 8, 2014
Commits on Sep 26, 2013
  1. Redirect Spark github

    rxin committed Sep 26, 2013
  2. Merge pull request #670 from jey/ec2-ssh-improvements

    EC2 SSH improvements
    rxin committed Sep 26, 2013
  3. Merge pull request #930 from holdenk/master

    Add mapPartitionsWithIndex
    rxin committed Sep 26, 2013
  4. Merge pull request #7 from wannabeast/memorystore-fixes

    some minor fixes to MemoryStore
    
    This is a repeat of #5, moved to its own branch in my repo.
    
    This makes all updates to   on ; it skips on synchronizing the reads where it can get away with it.
    rxin committed Sep 26, 2013
  5. Merge pull request #9 from rxin/limit

    Smarter take/limit implementation.
    pwendell committed Sep 26, 2013
Commits on Sep 24, 2013
  1. Update build version in master

    pwendell committed Sep 24, 2013
  2. Fix formatting :)

    holdenk committed Sep 24, 2013
Commits on Sep 23, 2013
  1. Merge remote-tracking branch 'pr/12'

    Fix spacing so java.io.tmpdir doesn't run on with SPARK_JAVA_OPTS
    rxin committed Sep 23, 2013
  2. Fix spacing so that the java.io.tmpdir doesn't run on with SPARK_JAVA…

    …_OPTS
    Y.CORP.YAHOO.COM\tgraves committed Sep 23, 2013
  3. Switch indent from 2 to 4 spaces

    holdenk committed Sep 23, 2013
Commits on Sep 22, 2013
  1. Merge pull request #928 from jerryshao/fairscheduler-refactor

    Refactor FairSchedulableBuilder
    rxin committed Sep 22, 2013
  2. Remove infix style and others

    jerryshao committed Sep 13, 2013
  3. Refactor FairSchedulableBuilder:

    1. Configuration can be read from classpath if not set explicitly.
    2. Add missing close handler.
    jerryshao committed Sep 12, 2013
  4. Merge pull request #937 from jerryshao/localProperties-fix

    Fix PR926 local properties issues in Spark Streaming like scenarios
    rxin committed Sep 22, 2013
  5. Merge pull request #941 from ilikerps/master

    Add "org.apache." prefix to packages in spark-class
    rxin committed Sep 22, 2013
  6. Merge pull request #940 from ankurdave/clear-port-properties-after-tests

    After unit tests, clear port properties unconditionally
    rxin committed Sep 22, 2013
Commits on Sep 21, 2013
  1. Add "org.apache." prefix to packages in spark-class

    Lacking this, the if/case statements never trigger on Spark 0.8.0+.
    aarondav committed Sep 21, 2013
  2. Smarter take/limit implementation.

    rxin committed Sep 21, 2013
Commits on Sep 20, 2013
  1. Synchronize on "entries" the remaining update to "currentMemory".

    Make "currentMemory" @volatile, so that it's reads in ensureFreeSpace() are atomic and up-to-date--i.e., currentMemory can't increase while putLock is held (though it could decrease, which would only help ensureFreeSpace()).
    wannabeast committed Sep 20, 2013
  2. After unit tests, clear port properties unconditionally

    In MapOutputTrackerSuite, the "remote fetch" test sets spark.driver.port
    and spark.hostPort, assuming that they will be cleared by
    LocalSparkContext. However, the test never sets sc, so it remains null,
    causing LocalSparkContext to skip clearing these properties. Subsequent
    tests therefore fail with java.net.BindException: "Address already in
    use".
    
    This commit makes LocalSparkContext clear the properties even if sc is
    null.
    ankurdave committed Sep 20, 2013
Commits on Sep 19, 2013
  1. Merge pull request #938 from ilikerps/master

    Fix issue with spark_ec2 seeing empty security groups
    pwendell committed Sep 19, 2013
  2. Fix issue with spark_ec2 seeing empty security groups

    Under unknown, but occasional, circumstances, reservation.groups is empty
    despite reservation.instances each having groups. This means that the
    spark_ec2 get_existing_clusters() method would fail to find any instances.
    To fix it, we simply use the instances' groups as the source of truth.
    
    Note that this is actually just a revival of PR #827, now that the issue
    has been reproduced.
    aarondav committed Sep 19, 2013
Commits on Sep 18, 2013
Commits on Sep 16, 2013
Commits on Sep 15, 2013
  1. Merge pull request #933 from jey/yarn-typo-fix

    Fix typo in Maven build docs
    pwendell committed Sep 15, 2013
  2. Fix typo in Maven build docs

    jey committed Sep 15, 2013