SPARK-1474: Spark on yarn assembly doesn't include AmIpFilter#406
Closed
tgravescs wants to merge 1 commit intoapache:masterfrom
Closed
SPARK-1474: Spark on yarn assembly doesn't include AmIpFilter#406tgravescs wants to merge 1 commit intoapache:masterfrom
tgravescs wants to merge 1 commit intoapache:masterfrom
Conversation
…yarn.server.webproxy.amfilter.AmIpFilter
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. |
|
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14119/ |
Contributor
Author
|
any comments on this? Do we want to wait and put this in 1.1? |
Contributor
Author
|
might be nice to pull into 1.0 so you can actually use the assembly standalone on yarn without hadoop jars being there. |
Contributor
|
Thanks tom, I've pulled this in. |
asfgit
pushed a commit
that referenced
this pull request
May 6, 2014
We use org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter in spark on yarn but are not included it in the assembly jar. I tested this on yarn cluster by removing the yarn jars from the classpath and spark runs fine now. Author: Thomas Graves <tgraves@apache.org> Closes #406 from tgravescs/SPARK-1474 and squashes the following commits: 1548bf9 [Thomas Graves] SPARK-1474: Spark on yarn assembly doesn't include org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter (cherry picked from commit 1e82990) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
pwendell
pushed a commit
to pwendell/spark
that referenced
this pull request
May 12, 2014
Extending Java API coverage Hi, I have added three new methods to JavaRDD. Please review and merge.
pdeyhim
pushed a commit
to pdeyhim/spark-1
that referenced
this pull request
Jun 25, 2014
We use org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter in spark on yarn but are not included it in the assembly jar. I tested this on yarn cluster by removing the yarn jars from the classpath and spark runs fine now. Author: Thomas Graves <tgraves@apache.org> Closes apache#406 from tgravescs/SPARK-1474 and squashes the following commits: 1548bf9 [Thomas Graves] SPARK-1474: Spark on yarn assembly doesn't include org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
bzhaoopenstack
pushed a commit
to bzhaoopenstack/spark
that referenced
this pull request
Sep 11, 2019
Support to intergrate with Ansible stable-2.7
RolatZhang
pushed a commit
to RolatZhang/spark
that referenced
this pull request
Mar 18, 2022
* KE-33600 Add Parquet Column Name Check Switch * KE-33600 update SQLConf version Co-authored-by: longfei.jiang <longfei.jiang@kyligence.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
We use org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter in spark on yarn but are not included it in the assembly jar.
I tested this on yarn cluster by removing the yarn jars from the classpath and spark runs fine now.