Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove unused tools to free up CI disk space #1864

Merged
merged 3 commits into from Feb 3, 2021

Conversation

jul-sh
Copy link
Contributor

@jul-sh jul-sh commented Feb 3, 2021

Currently it seems our CI workflow is running out of space.
Some PRs where this is happening:

#1843
#1846
#1857

This tries to patch it by removing some prebuilt tools included by GitHub to free up more space.
An approach recommend here: actions/runner-images#709 (comment)
And used by big repos such as https://github.com/facebook/proxygen

Checklist

  • Pull request affects core Oak functionality (e.g. runtime, SDK, ABI)
    • I have written tests that cover the code changes.
    • I have checked that these tests are run by
      Cloudbuild
    • I have updated documentation accordingly.
    • I have raised an issue to
      cover any TODOs and/or unfinished work.
  • Pull request includes prototype/experimental work that is under
    construction.

@google-cla google-cla bot added the cla: yes label Feb 3, 2021
- name: Free disk space
run: |
df --human-readable
sudo swapoff --all
sudo rm --force /swapfile
sudo apt clean
docker rmi $(docker image ls --all --quiet)
rm -rf "$AGENT_TOOLSDIRECTORY"

This comment was marked as outdated.

@jul-sh
Copy link
Contributor Author

jul-sh commented Feb 3, 2021

Seems quite effective, cleans up an additional 7GB compared to our previous setup.
In fact, I'm tempted to remove the current line disabling the swap file. It's only 512MB and disabling it seems a bit unsafe: https://help.ubuntu.com/community/SwapFaq#Why_do_I_need_swap.3

@jul-sh jul-sh marked this pull request as ready for review February 3, 2021 16:14
@jul-sh jul-sh merged commit 70f9999 into project-oak:main Feb 3, 2021
@jul-sh jul-sh deleted the free-CI-space branch February 3, 2021 17:37
@daviddrysdale
Copy link
Contributor

Thank you @juliettepretot ! I was dreading the process of figuring out why CI was broken for #1846 and now I don't have to!

@github-actions
Copy link

github-actions bot commented Feb 3, 2021

Reproducibility Index:

6f651fd0da154010969d3dbac57a7880c2ed2a91d8246484c7247be7c4db4667  ./examples/abitest/bin/abitest_0_frontend.wasm
f7ac0a621db5c53b3f86f77238f4df1ed5c6af09a63bf674a746678f2cb0644c  ./examples/abitest/bin/abitest_1_backend.wasm
9c108f615413aa114e68438d0f902b502e6c1c5e7d4fe7bb8bc7b750d4def60e  ./examples/aggregator/bin/aggregator.wasm
3105aacfdb98ef516ec58497acfb72a3af591a67faffd6c2a2aa7df98409e68d  ./examples/chat/bin/chat.wasm
1a8257aed76024e8a5c1f400a9657402b46ace69fc26bb4849f87c38ea2b2e96  ./examples/hello_world/bin/hello_world.wasm
8c97d83fe6aa157dbbb01b0931e206bc4d9da058adfc2e0df46a7d1979c495c2  ./examples/hello_world/bin/translator.wasm
00dc476d438a40e46fd5827bfc9e553d1074d3224117f4cb47057f099cb1ca56  ./examples/http_server/bin/http_server.wasm
b43a49ae8e06e165e282ed877050f1ab61ac84ffed8d04011c5dfbd9ea79b5e6  ./examples/injection/bin/injection.wasm
3d525c7bf98f76a3ac545ecd14722d900a804c91c69f04afd33b2e41a7e8a32a  ./examples/private_set_intersection/bin/private_set_intersection.wasm
e7baa8bbf76625baa88769d8a31e250886ad5ab527a7af0f0474400b278e5530  ./examples/private_set_intersection/bin/private_set_intersection_handler.wasm
8c97d83fe6aa157dbbb01b0931e206bc4d9da058adfc2e0df46a7d1979c495c2  ./examples/translator/bin/translator.wasm
281511f222523d02d7a369d6b00c8f4e80d3ad6754af29a04e8b4864fbc1a2bc  ./examples/trusted_database/bin/trusted_database.wasm
26e0fd1be9f3160842dce5363a29641a9c0f2a3a46170b4f3552e6f8f285eedf  ./oak_loader/bin/oak_loader

Reproducibility Index diff:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants