New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SPARK-1305: Support persisting RDD's directly to Tachyon #158

Closed
wants to merge 56 commits into
base: master
from

Conversation

Projects
None yet
7 participants
@RongGu
Contributor

RongGu commented Mar 16, 2014

Move the PR#468 of apache-incubator-spark to the apache-spark
"Adding an option to persist Spark RDD blocks into Tachyon."

@RongGu

This comment has been minimized.

Show comment
Hide comment
@RongGu

RongGu Mar 16, 2014

Contributor

The PR is moved here, and the left commits will be push to this site then.

Contributor

RongGu commented Mar 16, 2014

The PR is moved here, and the left commits will be push to this site then.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 16, 2014

Merged build triggered.

AmplabJenkins commented Mar 16, 2014

Merged build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 16, 2014

Merged build started.

AmplabJenkins commented Mar 16, 2014

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 16, 2014

Merged build finished.

AmplabJenkins commented Mar 16, 2014

Merged build finished.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 16, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13201/

AmplabJenkins commented Mar 16, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13201/

"Adding an option to persist Spark RDD blocks into Tachyon." move the…
… PR#468 of apache-incubator-spark to the apache-spark
@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 17, 2014

Merged build triggered.

AmplabJenkins commented Mar 17, 2014

Merged build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 17, 2014

Merged build started.

AmplabJenkins commented Mar 17, 2014

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 17, 2014

Merged build finished.

AmplabJenkins commented Mar 17, 2014

Merged build finished.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 17, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13209/

AmplabJenkins commented Mar 17, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13209/

@mateiz

This comment has been minimized.

Show comment
Hide comment
@mateiz

mateiz Mar 19, 2014

Contributor

This seems to be failing tests, have you run them locally?

Contributor

mateiz commented Mar 19, 2014

This seems to be failing tests, have you run them locally?

@pwendell

This comment has been minimized.

Show comment
Hide comment
@pwendell

pwendell Mar 21, 2014

Contributor

Hey @RongGu we've made some changes to the block store that I think will require up-merging this patch to master. We're interested in merging this soon. Any chance you could take a look at this and bring it up to date? Thanks!

Contributor

pwendell commented Mar 21, 2014

Hey @RongGu we've made some changes to the block store that I think will require up-merging this patch to master. We're interested in merging this soon. Any chance you could take a look at this and bring it up to date? Thanks!

@RongGu

This comment has been minimized.

Show comment
Hide comment
@RongGu

RongGu Mar 21, 2014

Contributor

Hey @mateiz . Yes, I verified the whole thing last night. I set up a tachyon locally and the example I added using tachyonstore works well. Also, the BlockManagerSuite with my added test passed here.
BTW, the whole test never passed here on my laptop from the very beginning to now. Some test failed here because of my environment problem,such as OOM "Test org.apache.spark.JavaAPISuite.sparkContextUnion failed: java.lang.OutOfMemoryError: unable to create new native thread".
I would like to re-test the current version on the AmplabJenkins in order to check out current logs. The previous log link https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13209/ seems expired.

Contributor

RongGu commented Mar 21, 2014

Hey @mateiz . Yes, I verified the whole thing last night. I set up a tachyon locally and the example I added using tachyonstore works well. Also, the BlockManagerSuite with my added test passed here.
BTW, the whole test never passed here on my laptop from the very beginning to now. Some test failed here because of my environment problem,such as OOM "Test org.apache.spark.JavaAPISuite.sparkContextUnion failed: java.lang.OutOfMemoryError: unable to create new native thread".
I would like to re-test the current version on the AmplabJenkins in order to check out current logs. The previous log link https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13209/ seems expired.

@RongGu

This comment has been minimized.

Show comment
Hide comment
@RongGu

RongGu Mar 21, 2014

Contributor

Hey, @pwendell . Thanks for your notification. I've been busy with the school stuff here since this semester started. There is still a bit work need to done in this PR. I guess several other PRs will be merged into trunk in next a few days. Thus, I would like to perform the up-merging work when I have done with the feature in this PR and before you think it's okay to merge this PR. In a word, I would like to perform the up-merging work at last. Is this plan work for you?
I will continue to work on this PR in the next weeks in a part-time way. I believe the code/features merged into the Apahe Spark should have high quality.

Contributor

RongGu commented Mar 21, 2014

Hey, @pwendell . Thanks for your notification. I've been busy with the school stuff here since this semester started. There is still a bit work need to done in this PR. I guess several other PRs will be merged into trunk in next a few days. Thus, I would like to perform the up-merging work when I have done with the feature in this PR and before you think it's okay to merge this PR. In a word, I would like to perform the up-merging work at last. Is this plan work for you?
I will continue to work on this PR in the next weeks in a part-time way. I believe the code/features merged into the Apahe Spark should have high quality.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build triggered.

AmplabJenkins commented Mar 21, 2014

Build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build started.

AmplabJenkins commented Mar 21, 2014

Build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build finished.

AmplabJenkins commented Mar 21, 2014

Build finished.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13312/

AmplabJenkins commented Mar 21, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13312/

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build triggered.

AmplabJenkins commented Mar 21, 2014

Build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build started.

AmplabJenkins commented Mar 21, 2014

Build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build finished.

AmplabJenkins commented Mar 21, 2014

Build finished.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13318/

AmplabJenkins commented Mar 21, 2014

One or more automated tests failed
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13318/

@haoyuan

This comment has been minimized.

Show comment
Hide comment
@haoyuan

haoyuan Mar 21, 2014

Contributor

Jenkins, test this please

Contributor

haoyuan commented Mar 21, 2014

Jenkins, test this please

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build triggered.

AmplabJenkins commented Mar 21, 2014

Build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Mar 21, 2014

Build started.

AmplabJenkins commented Mar 21, 2014

Build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build started.

AmplabJenkins commented Apr 4, 2014

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build finished.

AmplabJenkins commented Apr 4, 2014

Merged build finished.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment

AmplabJenkins commented Apr 4, 2014

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build triggered.

AmplabJenkins commented Apr 4, 2014

Merged build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build started.

AmplabJenkins commented Apr 4, 2014

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build finished.

AmplabJenkins commented Apr 4, 2014

Merged build finished.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment

AmplabJenkins commented Apr 4, 2014

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build triggered.

AmplabJenkins commented Apr 4, 2014

Merged build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 4, 2014

Merged build started.

AmplabJenkins commented Apr 4, 2014

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 5, 2014

Merged build finished. All automated tests passed.

AmplabJenkins commented Apr 5, 2014

Merged build finished. All automated tests passed.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 5, 2014

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13782/

AmplabJenkins commented Apr 5, 2014

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13782/

@haoyuan

This comment has been minimized.

Show comment
Hide comment
@haoyuan

haoyuan Apr 5, 2014

Contributor

@mateiz Merged the master branch.

Contributor

haoyuan commented Apr 5, 2014

@mateiz Merged the master branch.

@mateiz

This comment has been minimized.

Show comment
Hide comment
@mateiz

mateiz Apr 5, 2014

Contributor

HY, it still doesn't merge. I see CONFLICT (content): Merge conflict in core/src/main/scala/org/apache/spark/util/Utils.scala.

Maybe you didn't update to the very latest one? Or maybe you got unlucky.

Contributor

mateiz commented Apr 5, 2014

HY, it still doesn't merge. I see CONFLICT (content): Merge conflict in core/src/main/scala/org/apache/spark/util/Utils.scala.

Maybe you didn't update to the very latest one? Or maybe you got unlucky.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 5, 2014

Merged build triggered.

AmplabJenkins commented Apr 5, 2014

Merged build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 5, 2014

Merged build started.

AmplabJenkins commented Apr 5, 2014

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 5, 2014

Merged build finished. All automated tests passed.

AmplabJenkins commented Apr 5, 2014

Merged build finished. All automated tests passed.

@AmplabJenkins

This comment has been minimized.

Show comment
Hide comment
@AmplabJenkins

AmplabJenkins Apr 5, 2014

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13788/

AmplabJenkins commented Apr 5, 2014

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13788/

@haoyuan

This comment has been minimized.

Show comment
Hide comment
@haoyuan

haoyuan Apr 5, 2014

Contributor

@mateiz See if it works now :)

Contributor

haoyuan commented Apr 5, 2014

@mateiz See if it works now :)

@pwendell

This comment has been minimized.

Show comment
Hide comment
@pwendell

pwendell Apr 5, 2014

Contributor

Merging cleanly now. I merged this - thanks!

Contributor

pwendell commented Apr 5, 2014

Merging cleanly now. I merged this - thanks!

@asfgit asfgit closed this in b50ddfd Apr 5, 2014

@RongGu

This comment has been minimized.

Show comment
Hide comment
@RongGu

RongGu Apr 5, 2014

Contributor

It seems that I just missed our last part. I am so happy this PR is merged. Thank @pwendell, @mateiz and @aarondav for your valuable comments all the way. Also, I appreciate @haoyuan 's leading and helping on this PR.

Contributor

RongGu commented Apr 5, 2014

It seems that I just missed our last part. I am so happy this PR is merged. Thank @pwendell, @mateiz and @aarondav for your valuable comments all the way. Also, I appreciate @haoyuan 's leading and helping on this PR.

@mateiz

This comment has been minimized.

Show comment
Hide comment
@mateiz

mateiz Apr 5, 2014

Contributor

No worries, thanks a lot to both you and Haoyuan for putting this together! This will be a great feature to have.

Contributor

mateiz commented Apr 5, 2014

No worries, thanks a lot to both you and Haoyuan for putting this together! This will be a great feature to have.

CrazyJvm added a commit to CrazyJvm/spark that referenced this pull request Jun 1, 2014

SPARK-1305: Support persisting RDD's directly to Tachyon
Move the PR#468 of apache-incubator-spark to the apache-spark
"Adding an option to persist Spark RDD blocks into Tachyon."

Author: Haoyuan Li <haoyuan@cs.berkeley.edu>
Author: RongGu <gurongwalker@gmail.com>

Closes apache#158 from RongGu/master and squashes the following commits:

72b7768 [Haoyuan Li] merge master
9f7fa1b [Haoyuan Li] fix code style
ae7834b [Haoyuan Li] minor cleanup
a8b3ec6 [Haoyuan Li] merge master branch
e0f4891 [Haoyuan Li] better check offheap.
55b5918 [RongGu] address matei's comment on the replication of offHeap storagelevel
7cd4600 [RongGu] remove some logic code for tachyonstore's replication
51149e7 [RongGu] address aaron's comment on returning value of the remove() function in tachyonstore
8adfcfa [RongGu] address arron's comment on inTachyonSize
120e48a [RongGu] changed the root-level dir name in Tachyon
5cc041c [Haoyuan Li] address aaron's comments
9b97935 [Haoyuan Li] address aaron's comments
d9a6438 [Haoyuan Li] fix for pspark
77d2703 [Haoyuan Li] change python api.git status
3dcace4 [Haoyuan Li] address matei's comments
91fa09d [Haoyuan Li] address patrick's comments
589eafe [Haoyuan Li] use TRY_CACHE instead of MUST_CACHE
64348b2 [Haoyuan Li] update conf docs.
ed73e19 [Haoyuan Li] Merge branch 'master' of github.com:RongGu/spark-1
619a9a8 [RongGu] set number of directories in TachyonStore back to 64; added a TODO tag for duplicated code from the DiskStore
be79d77 [RongGu] find a way to clean up some unnecessay metods and classed to make the code simpler
49cc724 [Haoyuan Li] update docs with off_headp option
4572f9f [RongGu] reserving the old apply function API of StorageLevel
04301d3 [RongGu] rename StorageLevel.TACHYON to Storage.OFF_HEAP
c9aeabf [RongGu] rename the StorgeLevel.TACHYON as StorageLevel.OFF_HEAP
76805aa [RongGu] unifies the config properties name prefix; add the configs into docs/configuration.md
e700d9c [RongGu] add the SparkTachyonHdfsLR example and some comments
fd84156 [RongGu] use randomUUID to generate sparkapp directory name on tachyon;minor code style fix
939e467 [Haoyuan Li] 0.4.1-thrift from maven central
86a2eab [Haoyuan Li] tachyon 0.4.1-thrift is in the staging repo. but jenkins failed to download it. temporarily revert it back to 0.4.1
16c5798 [RongGu] make the dependency on tachyon as tachyon-0.4.1-thrift
eacb2e8 [RongGu] Merge branch 'master' of https://github.com/RongGu/spark-1
bbeb4de [RongGu] fix the JsonProtocolSuite test failure problem
6adb58f [RongGu] Merge branch 'master' of https://github.com/RongGu/spark-1
d827250 [RongGu] fix JsonProtocolSuie test failure
716e93b [Haoyuan Li] revert the version
ca14469 [Haoyuan Li] bump tachyon version to 0.4.1-thrift
2825a13 [RongGu] up-merging to the current master branch of the apache spark
6a22c1a [Haoyuan Li] fix scalastyle
8968b67 [Haoyuan Li] exclude more libraries from tachyon dependency to be the same as referencing tachyon-client.
77be7e8 [RongGu] address mateiz's comment about the temp folder name problem. The implementation followed mateiz's advice.
1dcadf9 [Haoyuan Li] typo
bf278fa [Haoyuan Li] fix python tests
e82909c [Haoyuan Li] minor cleanup
776a56c [Haoyuan Li] address patrick's and ali's comments from the previous PR
8859371 [Haoyuan Li] various minor fixes and clean up
e3ddbba [Haoyuan Li] add doc to use Tachyon cache mode.
fcaeab2 [Haoyuan Li] address Aaron's comment
e554b1e [Haoyuan Li] add python code
47304b3 [Haoyuan Li] make tachyonStore in BlockMananger lazy val; add more comments StorageLevels.
dc8ef24 [Haoyuan Li] add old storelevel constructor
e01a271 [Haoyuan Li] update tachyon 0.4.1
8011a96 [RongGu] fix a brought-in mistake in StorageLevel
70ca182 [RongGu] a bit change in comment
556978b [RongGu] fix the scalastyle errors
791189b [RongGu] "Adding an option to persist Spark RDD blocks into Tachyon." move the PR#468 of apache-incubator-spark to the apache-spark

pdeyhim added a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014

SPARK-1305: Support persisting RDD's directly to Tachyon
Move the PR#468 of apache-incubator-spark to the apache-spark
"Adding an option to persist Spark RDD blocks into Tachyon."

Author: Haoyuan Li <haoyuan@cs.berkeley.edu>
Author: RongGu <gurongwalker@gmail.com>

Closes apache#158 from RongGu/master and squashes the following commits:

72b7768 [Haoyuan Li] merge master
9f7fa1b [Haoyuan Li] fix code style
ae7834b [Haoyuan Li] minor cleanup
a8b3ec6 [Haoyuan Li] merge master branch
e0f4891 [Haoyuan Li] better check offheap.
55b5918 [RongGu] address matei's comment on the replication of offHeap storagelevel
7cd4600 [RongGu] remove some logic code for tachyonstore's replication
51149e7 [RongGu] address aaron's comment on returning value of the remove() function in tachyonstore
8adfcfa [RongGu] address arron's comment on inTachyonSize
120e48a [RongGu] changed the root-level dir name in Tachyon
5cc041c [Haoyuan Li] address aaron's comments
9b97935 [Haoyuan Li] address aaron's comments
d9a6438 [Haoyuan Li] fix for pspark
77d2703 [Haoyuan Li] change python api.git status
3dcace4 [Haoyuan Li] address matei's comments
91fa09d [Haoyuan Li] address patrick's comments
589eafe [Haoyuan Li] use TRY_CACHE instead of MUST_CACHE
64348b2 [Haoyuan Li] update conf docs.
ed73e19 [Haoyuan Li] Merge branch 'master' of github.com:RongGu/spark-1
619a9a8 [RongGu] set number of directories in TachyonStore back to 64; added a TODO tag for duplicated code from the DiskStore
be79d77 [RongGu] find a way to clean up some unnecessay metods and classed to make the code simpler
49cc724 [Haoyuan Li] update docs with off_headp option
4572f9f [RongGu] reserving the old apply function API of StorageLevel
04301d3 [RongGu] rename StorageLevel.TACHYON to Storage.OFF_HEAP
c9aeabf [RongGu] rename the StorgeLevel.TACHYON as StorageLevel.OFF_HEAP
76805aa [RongGu] unifies the config properties name prefix; add the configs into docs/configuration.md
e700d9c [RongGu] add the SparkTachyonHdfsLR example and some comments
fd84156 [RongGu] use randomUUID to generate sparkapp directory name on tachyon;minor code style fix
939e467 [Haoyuan Li] 0.4.1-thrift from maven central
86a2eab [Haoyuan Li] tachyon 0.4.1-thrift is in the staging repo. but jenkins failed to download it. temporarily revert it back to 0.4.1
16c5798 [RongGu] make the dependency on tachyon as tachyon-0.4.1-thrift
eacb2e8 [RongGu] Merge branch 'master' of https://github.com/RongGu/spark-1
bbeb4de [RongGu] fix the JsonProtocolSuite test failure problem
6adb58f [RongGu] Merge branch 'master' of https://github.com/RongGu/spark-1
d827250 [RongGu] fix JsonProtocolSuie test failure
716e93b [Haoyuan Li] revert the version
ca14469 [Haoyuan Li] bump tachyon version to 0.4.1-thrift
2825a13 [RongGu] up-merging to the current master branch of the apache spark
6a22c1a [Haoyuan Li] fix scalastyle
8968b67 [Haoyuan Li] exclude more libraries from tachyon dependency to be the same as referencing tachyon-client.
77be7e8 [RongGu] address mateiz's comment about the temp folder name problem. The implementation followed mateiz's advice.
1dcadf9 [Haoyuan Li] typo
bf278fa [Haoyuan Li] fix python tests
e82909c [Haoyuan Li] minor cleanup
776a56c [Haoyuan Li] address patrick's and ali's comments from the previous PR
8859371 [Haoyuan Li] various minor fixes and clean up
e3ddbba [Haoyuan Li] add doc to use Tachyon cache mode.
fcaeab2 [Haoyuan Li] address Aaron's comment
e554b1e [Haoyuan Li] add python code
47304b3 [Haoyuan Li] make tachyonStore in BlockMananger lazy val; add more comments StorageLevels.
dc8ef24 [Haoyuan Li] add old storelevel constructor
e01a271 [Haoyuan Li] update tachyon 0.4.1
8011a96 [RongGu] fix a brought-in mistake in StorageLevel
70ca182 [RongGu] a bit change in comment
556978b [RongGu] fix the scalastyle errors
791189b [RongGu] "Adding an option to persist Spark RDD blocks into Tachyon." move the PR#468 of apache-incubator-spark to the apache-spark

ericl pushed a commit to ericl/spark that referenced this pull request Dec 30, 2016

[SC-5365] Add spark.databricks.acl.enabled to thrift tests
## What changes were proposed in this pull request?
The ACL Thrift end to end test currently fail because they do not set the `spark.databricks.acl.enabled` flag. This PR fixes that.

## How was this patch tested?
This is a test.

Author: Herman van Hovell <hvanhovell@databricks.com>

Closes apache#158 from hvanhovell/SC-5365-thrift.

yangyangyyy pushed a commit to yangyangyyy/spark that referenced this pull request Apr 26, 2017

Merge pull request apache#158 from facebook/revert-154-tejasp_smb_big…
…_patch

Revert "[FB-ONLY] Patch with all SMB related changes"

mccheah pushed a commit to mccheah/spark that referenced this pull request Oct 12, 2017

jlopezmalla pushed a commit to jlopezmalla/spark that referenced this pull request Feb 27, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment