Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixed broken pyspark shell. #444

Closed
wants to merge 2 commits into from
Closed

Fixed broken pyspark shell. #444

wants to merge 2 commits into from

Conversation

rxin
Copy link
Contributor

@rxin rxin commented Apr 18, 2014

No description provided.

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

rxin referenced this pull request Apr 18, 2014
@abhishekkr @rxin
[python alternative] pyspark require Python2, failing if system defau…
bb76eae 
…lt is Py3 from shell.py

Python alternative for #392; managed from shell.py

Author: AbhishekKr <abhikumar163@gmail.com>

Closes #399 from abhishekkr/pyspark_shell and squashes the following commits:

134bdc9 [AbhishekKr] pyspark require Python2, failing if system default is Py3 from shell.py
@yinxusen
Copy link
Contributor

Yep, I think python shell's document should be update same time. sys.version_info only became a named tuple in 2.7. To get this to work in 2.6, it needs to be accessed as a regular tuple:

if sys.version_info[0] != 2

see line 25.

@rxin
Copy link
Contributor Author

rxin commented Apr 18, 2014

Can you submit a PR for that?

@yinxusen
Copy link
Contributor

Sure. I'll modify it.

@rxin
Copy link
Contributor Author

rxin commented Apr 18, 2014

Actually never mind I will do it here. You can't just change that line without changing the indent anyway.

@rxin
Copy link
Contributor Author

rxin commented Apr 18, 2014

ok pushed

@yinxusen
Copy link
Contributor

Yes, agree with you.

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@AmplabJenkins
Copy link

Merged build finished.

@AmplabJenkins
Copy link

Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14229/

@AmplabJenkins
Copy link

Merged build finished.

@AmplabJenkins
Copy link

Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14232/

@rxin
Copy link
Contributor Author

rxin commented Apr 18, 2014

Jenkins, retest this please.

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@rxin
Copy link
Contributor Author

rxin commented Apr 18, 2014

Ok I merged this since none of the tests will run this code path, and it is a hot fix.

asfgit pushed a commit that referenced this pull request Apr 18, 2014
@rxin
Fixed broken pyspark shell.
d8767c4 
Author: Reynold Xin <rxin@apache.org>

Closes #444 from rxin/pyspark and squashes the following commits:

fc11356 [Reynold Xin] Made the PySpark shell version checking compatible with Python 2.6.
571830b [Reynold Xin] Fixed broken pyspark shell.

(cherry picked from commit 81a152c)
Signed-off-by: Reynold Xin <rxin@apache.org>
@asfgit asfgit closed this in 81a152c Apr 18, 2014
@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14239/

pwendell added a commit to pwendell/spark that referenced this pull request May 12, 2014
@pwendell
Merge pull request apache#444 from mateiz/py-version
4f0c361 
Clarify that Python 2.7 is only needed for MLlib
pdeyhim pushed a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014
@rxin @pdeyhim
Fixed broken pyspark shell.
b8bc976 
Author: Reynold Xin <rxin@apache.org>

Closes apache#444 from rxin/pyspark and squashes the following commits:

fc11356 [Reynold Xin] Made the PySpark shell version checking compatible with Python 2.6.
571830b [Reynold Xin] Fixed broken pyspark shell.
@rxin rxin deleted the pyspark branch August 13, 2014 08:01
andrewor14 pushed a commit to andrewor14/spark that referenced this pull request Jan 8, 2015
@pwendell
Merge pull request apache#444 from mateiz/py-version
4ccedb3 
Clarify that Python 2.7 is only needed for MLlib
(cherry picked from commit 4f0c361)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
markhamstra pushed a commit to markhamstra/spark that referenced this pull request Nov 7, 2017
@mccheah @ash211
Use a list of environment variables for JVM options. (apache#444)
f7b5820 
* Use a list of environment variables for JVM options.

* Fix merge conflicts.
bzhaoopenstack pushed a commit to bzhaoopenstack/spark that referenced this pull request Sep 11, 2019
@mrhillsman
Update the pipeline and jobs to add 1.13 K8s
d6fb15d 
Fixes issues apache#444

Signed-off-by: Melvin Hillsman <mrhillsman@gmail.com>
arjunshroff pushed a commit to arjunshroff/spark that referenced this pull request Nov 24, 2020
@ekrivokonmapr
MapR [SPARK-465] Error messages after update of spark 2.4 (apache#444)
98e4445
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@rxin @AmplabJenkins @yinxusen