Skip to content

Add compilation cache in 2 Linux CPU pipelines and refactor the Linux build step with cache - #15484

Merged
Yi Zhang (mszhanyi) merged 33 commits into
mainfrom
zhanyi/linuxcicache
Apr 14, 2023
Merged

Add compilation cache in 2 Linux CPU pipelines and refactor the Linux build step with cache#15484
Yi Zhang (mszhanyi) merged 33 commits into
mainfrom
zhanyi/linuxcicache

Conversation

@mszhanyi

@mszhanyi Yi Zhang (mszhanyi) commented Apr 12, 2023

Copy link
Copy Markdown
Contributor

Description

  1. Add compilation cache in Linux CPU ARM and Linux Minimal Build.
  2. Integrate 4 Linux CPU build step with cache into one.
  3. install ccache from source code in Linux ARM64 image.

Motivation and Context

  1. Enable more build steps with compilation cache.
  2. Make it easier to add cache.

It could save 40 more minutes of compilation time in Linux ARM64.
https://dev.azure.com/onnxruntime/onnxruntime/_build/results?buildId=959619&view=logs&j=1e0830bb-fd74-5d0a-5029-1c63b4266d7b&t=75260ed7-7566-5947-2095-566660191920

@mszhanyi
Yi Zhang (mszhanyi) requested a review from a team April 12, 2023 13:45
@mszhanyi
Yi Zhang (mszhanyi) marked this pull request as draft April 12, 2023 15:12
@mszhanyi
Yi Zhang (mszhanyi) marked this pull request as ready for review April 13, 2023 01:06
os_major_version=$(cat /etc/redhat-release | tr -dc '0-9.'|cut -d \. -f1)

echo "installing for os major version : $os_major_version"
yum install -y which gdb redhat-lsb-core expat-devel tar unzip zlib-devel make libunwind bzip2 bzip2-devel No newline at end of file

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, just whitespace changes?

@mszhanyi Yi Zhang (mszhanyi) Apr 13, 2023

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. I think it's made by VSCode.
I had edit it so the VSCode always add a trailing blank line.

Comment thread tools/ci_build/github/azure-pipelines/templates/py-linux.yml Outdated
Comment thread tools/ci_build/github/azure-pipelines/templates/linux-build-step-with-cache.yml Outdated
Comment thread tools/ci_build/build.py
@mszhanyi
Yi Zhang (mszhanyi) merged commit 4e1f758 into main Apr 14, 2023
@mszhanyi
Yi Zhang (mszhanyi) deleted the zhanyi/linuxcicache branch April 14, 2023 15:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants