Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Comparing changes

Choose two branches to see what's changed or to start a new pull request. If you need to, you can also compare across forks.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also compare across forks.
base fork: MLnick/spark
...
head fork: MLnick/spark
Checking mergeability… Don't worry, you can still create the pull request.
Commits on Feb 28, 2013
@stephenh stephenh Make Executor fields volatile since they're read from the thread pool. 80eecd2
@stephenh stephenh Don't create the Executor until we have everything it needs. 6415c2b
Commits on Mar 04, 2013
@markhamstra markhamstra mapWith, flatMapWith and filterWith 9148b96
Commits on Mar 05, 2013
@markhamstra markhamstra whitespace formatting d046d8a
@markhamstra markhamstra refactor mapWith, flatMapWith and filterWith to each use two paramete…
…r lists
5ff0810
Commits on Mar 10, 2013
Imran Rashid rename remoteFetchWaitTime to fetchWaitTime, since it also includes t…
…ime from local fetches
ec30188
Imran Rashid enable task metrics in local mode, add tests 20f01a0
@markhamstra markhamstra Merge branch 'master' of https://github.com/mesos/spark into WithThing b57df1f
Commits on Mar 11, 2013
@markhamstra markhamstra refactored _With API and added foreachPartition 1289e71
Imran Rashid add a small wait to one task to make sure some task runtime really is…
… non-zero
9f97f2f
Imran Rashid increase sleep time 8a11ac3
@markhamstra markhamstra deleted excess curly braces 562893b
@markhamstra markhamstra Merge branch 'master' of https://github.com/mesos/spark into WithThing a6de802
@woggle woggle Send block sizes as longs. 769d399
Commits on Mar 12, 2013
@stephenh stephenh More quickly call close in HadoopRDD.
This also refactors out the common "gotNext" iterator pattern into
a shared utility class.
9e68f48
@stephenh stephenh Forgot equals. 0cf3204
@stephenh stephenh Remove NextIterator.close default implementation. 8f00d23
Commits on Mar 13, 2013
@mateiz mateiz Merge pull request #518 from woggling/long-bm-sizes
Send block sizes as longs in BlockManager updates
00c4d23
@andyk andyk Fix broken link in Quick Start. b631097
@andyk andyk Fix another broken link in quick start. cf73fbd
@mateiz mateiz Merge pull request #523 from andyk/master
Fix broken link in Quick Start
2d477fd
@stephenh stephenh Add NextIterator.closeIfNeeded. 1a175d1
@stephenh stephenh Add a test for NextIterator. e7f1a69
@markhamstra markhamstra Merge branch 'master' of https://github.com/mesos/spark into WithThing cd5b947
@andyk andyk Fix broken link to YARN documentation. c909762
@stephenh stephenh Simplify SubtractedRDD in preparation from subtractByKey. 63fe225
Commits on Mar 14, 2013
@mateiz mateiz Merge pull request #524 from andyk/master
Fix broken link to YARN documentation
3c97276
@mateiz mateiz Merge pull request #521 from stephenh/earlyclose
Close the reader in HadoopRDD as soon as iteration end.
4032beb
@stephenh stephenh Finished subtractByKeys. 4632c45
@stephenh stephenh Allow subtractByKey's other argument to have a different value type. 7d8bb4d
@stephenh stephenh Fix tabs that snuck in. 7786881
@markhamstra markhamstra added foldByKey b1422cb
@markhamstra markhamstra restrict V type of foldByKey in order to retain ClassManifest; added …
…foldByKey to Java API and test
16a4ca4
Commits on Mar 15, 2013
@MLnick Adding Java versions of Pi and LogQuery 13757b1
@markhamstra markhamstra Fuller implementation of foldByKey 8570103
@markhamstra markhamstra whitespace cleanup 1a40704
@mbautin mbautin Add a log4j compile dependency to fix build in IntelliJ
Also rename parent project to spark-parent (otherwise it shows up as
"parent" in IntelliJ, which is very confusing).
7fd2708
@mateiz mateiz Merge pull request #530 from mbautin/master-update-log4j-and-make-com…
…pile-in-IntelliJ

Add a log4j compile dependency to fix build in IntelliJ
f9fa2ad
@mateiz mateiz Merge pull request #516 from squito/fix_local_metrics
Fix local metrics
cdbfd1e
Commits on Mar 16, 2013
@markhamstra markhamstra Merge branch 'master' of https://github.com/mesos/spark into foldByKey ef75be3
@mateiz mateiz Merge pull request #525 from stephenh/subtractByKey
Add PairRDDFunctions.subtractByKey.
c1e9cdc
@markhamstra markhamstra Merge branch 'master' of https://github.com/mesos/spark into WithThing 38454c4
@markhamstra markhamstra _With[Matei] 80fc8c8
@markhamstra markhamstra Merge branch 'master' of https://github.com/mesos/spark into foldByKey 1fb192e
@markhamstra markhamstra refactor foldByKey to use combineByKey ca9f81e
@markhamstra markhamstra whitespace 32979b5
@markhamstra markhamstra fix wayward comma in doc comment 9784fc1
@markhamstra markhamstra constructorOfA -> constructA in doc comments ab33e27
Commits on Mar 17, 2013
@MLnick Changes to more closely match line length limit style b990cae
@andyk andyk Adds page to docs about building using Maven.
Adds links to new instructions in:
* The main Spark project README.md
* The docs nav menu called "More"
* The docs Overview page under the "Building" and "Where to Go from Here" sections
ad7f045
Commits on Mar 18, 2013
@stephenh stephenh Remove try/catch block that can't be hit. fb34967
Commits on Mar 19, 2013
@sasurfer sasurfer CoalescedRDD changed to work with a big number of partitions both in …
…the original and the new coalesced RDD.

The limitation was in the range that Scala.Int can represent.
aceae02
@prettynatty prettynatty call setConf from input format if it is Configurable bd167f8
@MLnick Adding Java K-Means example 568ddf7
@MLnick A few cosmetic changes for JavaKMeans 9fa47a2
Commits on Mar 20, 2013
@mateiz mateiz Merge pull request #537 from wishbear/configurableInputFormat
call setConf from input format if it is Configurable
71e53f8
@mateiz mateiz Merge pull request #534 from stephenh/removetrycatch
Remove try/catch block that can't be hit.
1cbbe94
@mateiz mateiz Merge pull request #536 from sasurfer/master
CoalescedRDD for many partitions
945d1e7
@rxin rxin Added mapSideCombine flag to CoGroupedRDD. Added unit test for
CoGroupedRDD.
00a1130
@rxin rxin Merge branch 'master' of github.com:mesos/spark into cogroup d48ee7e
@MLnick Java indentation 2 --> 4 spaces 7a443bb
@MLnick Java indentation 4 --> 2 spaces 52398cc
@MLnick Merge branch 'java-examples' of https://github.com/MLnick/spark into …
…java-examples
5a378a1
@mateiz mateiz Merge pull request #526 from markhamstra/foldByKey
Add foldByKey
b812e6b
@mateiz mateiz Merge pull request #528 from MLnick/java-examples
[SPARK-707] Adding Java versions of Pi, LogQuery and K-Means examples
ca4d083
@stephenh stephenh Merge branch 'master' into volatile 4f42153
Commits on Mar 21, 2013
@andyk andyk Fixing typos pointed out by Matei 446b801
@mateiz mateiz Merge pull request #538 from rxin/cogroup
Added mapSideCombine flag to CoGroupedRDD. Added unit test for CoGroupedRDD.
3558849
@mateiz mateiz Merge pull request #532 from andyk/master
SPARK-715: Adds instructions for building with Maven to documentation
4c5efcf
Commits on Mar 23, 2013
@mateiz mateiz Merge pull request #510 from markhamstra/WithThing
mapWith, flatMapWith and filterWith
fd53f2f
@mateiz mateiz Merge pull request #505 from stephenh/volatile
Make Executor fields volatile since they're read from the thread pool.
b8949ca