Skip to content

Comments

[SPARK-42167][INFRA] Improve GitHub Action lint job to stop on failures earlier#39716

Closed
dongjoon-hyun wants to merge 4 commits intoapache:masterfrom
dongjoon-hyun:SPARK-42167
Closed

[SPARK-42167][INFRA] Improve GitHub Action lint job to stop on failures earlier#39716
dongjoon-hyun wants to merge 4 commits intoapache:masterfrom
dongjoon-hyun:SPARK-42167

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Jan 24, 2023

What changes were proposed in this pull request?

This PR aims to improve GitHub Action lint job to stop on failure earlier.

Why are the changes needed?

Currently, we designed to put all installation steps before testing. However, we don't need to install SparkR dependency if the PR fails at LICENSE check.

By pairing the installation and testing steps, we can skip as much as possible in case of failures.

Does this PR introduce any user-facing change?

No. This is a INFRA change.

How was this patch tested?

Manual review.

@github-actions github-actions bot added the INFRA label Jan 24, 2023
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-42167][INFRA] Improve GitHub Action job to stop on failures earlier [SPARK-42167][INFRA] Improve GitHub Action lint job to stop on failures earlier Jan 24, 2023
@dongjoon-hyun
Copy link
Member Author

cc @HyukjinKwon

@HyukjinKwon
Copy link
Member

cc @Yikun too

python3.9 -m pip install 'sphinx<3.1.0' mkdocs pydata_sphinx_theme ipython nbsphinx numpydoc 'jinja2<3.0.0' 'markupsafe==2.0.1' 'pyzmq<24.0.0'
python3.9 -m pip install 'sphinx<3.1.0' mkdocs pydata_sphinx_theme nbsphinx numpydoc 'jinja2<3.0.0' 'markupsafe==2.0.1' 'pyzmq<24.0.0'
python3.9 -m pip install ipython_genutils # See SPARK-38517
python3.9 -m pip install sphinx_plotly_directive 'numpy>=1.20.0' pyarrow pandas 'plotly>=4.8' 'grpcio==1.48.1' 'protobuf==3.19.5' 'mypy-protobuf==3.3.0' 'grpc-stubs==1.24.11' 'googleapis-common-protos-stubs==2.2.0'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for separating this.

@dongjoon-hyun
Copy link
Member Author

Thank you, @HyukjinKwon . The lint job passed. Merged to master.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-42167 branch January 24, 2023 17:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants