Skip to content

[SPARK-44554][INFRA][FOLLOWUP] Install IPython for the Python linter check in the daily test for branch-3.3#42413

Closed
LuciferYang wants to merge 1 commit intoapache:masterfrom
LuciferYang:SPARK-44554-FOLLOWUP
Closed

[SPARK-44554][INFRA][FOLLOWUP] Install IPython for the Python linter check in the daily test for branch-3.3#42413
LuciferYang wants to merge 1 commit intoapache:masterfrom
LuciferYang:SPARK-44554-FOLLOWUP

Conversation

@LuciferYang
Copy link
Contributor

@LuciferYang LuciferYang commented Aug 9, 2023

What changes were proposed in this pull request?

This pr aims to install IPython for the Python linter check in the daily test for branch-3.3.

Why are the changes needed?

To fix the Python linter check in the daily test of branch-3.3.

https://github.com/apache/spark/actions/runs/5805901293/job/15737802378

image

Does this PR introduce any user-facing change?

No

How was this patch tested?

Monitor GA

@github-actions github-actions bot added the INFRA label Aug 9, 2023
@LuciferYang LuciferYang changed the title [SPARK-44554][INFRA][FOLLOWUP] Install IPython for branch-3.3 Python linter check. [SPARK-44554][INFRA][FOLLOWUP] Install IPython for the Python linter check in the daily test for branch-3.3. Aug 9, 2023
@LuciferYang LuciferYang changed the title [SPARK-44554][INFRA][FOLLOWUP] Install IPython for the Python linter check in the daily test for branch-3.3. [SPARK-44554][INFRA][FOLLOWUP] Install IPython for the Python linter check in the daily test for branch-3.3 Aug 9, 2023
@LuciferYang
Copy link
Contributor Author

cc @zhengruifeng FYI

# Should delete this section after SPARK 3.3 EOL.
python3.9 -m pip install 'flake8==3.9.0' pydata_sphinx_theme 'mypy==0.920' 'pytest==7.1.3' 'pytest-mypy-plugins==1.9.3' numpydoc 'jinja2<3.0.0' 'black==21.12b0'
python3.9 -m pip install 'pandas-stubs==1.2.0.53'
python3.9 -m pip install 'pandas-stubs==1.2.0.53' ipython
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I found https://github.com/apache/spark/pull/39716/files move ipython install from Install dependencies for documentation generation to Install Python linter dependencies

@LuciferYang
Copy link
Contributor Author

Merged into master. Thanks @HyukjinKwon @zhengruifeng

@LuciferYang
Copy link
Contributor Author

https://github.com/apache/spark/actions/runs/5817966464

image

The last test was successful

@zhengruifeng
Copy link
Contributor

@LuciferYang awesome, finally!

but it really too cumbersome to maintain, we need to figure out how to simplify it.

hvanhovell pushed a commit to hvanhovell/spark that referenced this pull request Aug 13, 2023
…r check in the daily test for branch-3.3

### What changes were proposed in this pull request?
This pr aims to install `IPython` for the Python linter check in the daily test for branch-3.3.

### Why are the changes needed?
To fix the Python linter check in the daily test of branch-3.3.

https://github.com/apache/spark/actions/runs/5805901293/job/15737802378

<img width="1030" alt="image" src="https://github.com/apache/spark/assets/1475305/59896b6a-b710-4772-9139-189c7ea73fe5">

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Monitor GA

Closes apache#42413 from LuciferYang/SPARK-44554-FOLLOWUP.

Authored-by: yangjie01 <yangjie01@baidu.com>
Signed-off-by: yangjie01 <yangjie01@baidu.com>
valentinp17 pushed a commit to valentinp17/spark that referenced this pull request Aug 24, 2023
…r check in the daily test for branch-3.3

### What changes were proposed in this pull request?
This pr aims to install `IPython` for the Python linter check in the daily test for branch-3.3.

### Why are the changes needed?
To fix the Python linter check in the daily test of branch-3.3.

https://github.com/apache/spark/actions/runs/5805901293/job/15737802378

<img width="1030" alt="image" src="https://github.com/apache/spark/assets/1475305/59896b6a-b710-4772-9139-189c7ea73fe5">

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Monitor GA

Closes apache#42413 from LuciferYang/SPARK-44554-FOLLOWUP.

Authored-by: yangjie01 <yangjie01@baidu.com>
Signed-off-by: yangjie01 <yangjie01@baidu.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants