Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(ci): github action runner disk full error #641

Closed
petermetz opened this issue Mar 9, 2021 · 0 comments · Fixed by #645
Closed

fix(ci): github action runner disk full error #641

petermetz opened this issue Mar 9, 2021 · 0 comments · Fixed by #645
Assignees
@petermetz
Labels
bug Something isn't working dependencies Pull requests that update a dependency file Developer_Experience Performance Everything related to how fast/efficient the software or it's tooling (e.g. build) is.

Comments

@petermetz
Copy link
Member

Describe the bug

With the additional tests that we have added recently it became an issue that the GH action runner has a finite, limited amount of disk space allocated to our CI execution and it became full, causing the tests to fail as a false negative.

To Reproduce

Docker pull a few more gigabytes worth of docker images during the CI execution and observe that it starts to crash despite the tests themselves running fine on a developer machine that has plenty of disk space to spare compare to the GH action runner virtual machine environment.

Expected behavior

CI consistently fails or succeeds the same way as it does on a developer machine.

Logs/Stack traces

N/A

Screenshots

N/A

Cloud provider or hardware configuration:

Github Actions CI Runner Virtual Machine

Operating system name, version, build:

Ubuntu 20.04 LTS

Hyperledger Cactus release version or commit (git rev-parse --short HEAD):

aa070ade45c82cd067cbea09c04fe7b94f76368e

Hyperledger Cactus Plugins/Connectors Used

N/A

Additional context

This came up while developing the Fabric contract deployment endpoint.

cc: @takeutak @sfuji822 @hartm @jonathan-m-hamilton @AzaharaC @jordigiam @kikoncuo
@petermetz petermetz added bug Something isn't working dependencies Pull requests that update a dependency file Developer_Experience Performance Everything related to how fast/efficient the software or it's tooling (e.g. build) is. labels Mar 9, 2021
@petermetz petermetz self-assigned this Mar 9, 2021
petermetz added a commit to petermetz/cacti that referenced this issue Mar 9, 2021
@petermetz
fix(ci): github action runner disk full error hyperledger#641
26afbf7 
Added a docker resource pruning call to the
test case that was triggering the disk full issue
while pulling the Fabric AIO image necessary
for it's operation.

It is expected that this error will crop up in the future with different test cases and if and when that
happens we can add more of the same to
those tests as well, but for now, I did not want to
make this change to every single test case since
it wasn't strictly necessary and a better solution may
come along in the near future as well.

Fixes hyperledger#641

Signed-off-by: Peter Somogyvari <peter.somogyvari@accenture.com>
petermetz added a commit to petermetz/cacti that referenced this issue Mar 10, 2021
@petermetz
fix(ci): github action runner disk full error hyperledger#641
3ba8883 
Added a docker resource pruning call to the
test case that was triggering the disk full issue
while pulling the Fabric AIO image necessary
for it's operation.

It is expected that this error will crop up in the future with different test cases and if and when that
happens we can add more of the same to
those tests as well, but for now, I did not want to
make this change to every single test case since
it wasn't strictly necessary and a better solution may
come along in the near future as well.

Fixes hyperledger#641

Signed-off-by: Peter Somogyvari <peter.somogyvari@accenture.com>
petermetz added a commit to petermetz/cacti that referenced this issue Mar 10, 2021
@petermetz
fix(ci): github action runner disk full error hyperledger#641
1b6e829 
Added a docker resource pruning call to the
test case that was triggering the disk full issue
while pulling the Fabric AIO image necessary
for it's operation.

It is expected that this error will crop up in the future with different test cases and if and when that
happens we can add more of the same to
those tests as well, but for now, I did not want to
make this change to every single test case since
it wasn't strictly necessary and a better solution may
come along in the near future as well.

Fixes hyperledger#641

Signed-off-by: Peter Somogyvari <peter.somogyvari@accenture.com>
@petermetz petermetz mentioned this issue Mar 10, 2021
Merged
petermetz added a commit that referenced this issue Mar 11, 2021
@petermetz
fix(ci): github action runner disk full error #641
193fe52 
Added a docker resource pruning call to the
test case that was triggering the disk full issue
while pulling the Fabric AIO image necessary
for it's operation.

It is expected that this error will crop up in the future with different test cases and if and when that
happens we can add more of the same to
those tests as well, but for now, I did not want to
make this change to every single test case since
it wasn't strictly necessary and a better solution may
come along in the near future as well.

Fixes #641

Signed-off-by: Peter Somogyvari <peter.somogyvari@accenture.com>
AzaharaC pushed a commit to kikoncuo/cactus that referenced this issue Mar 12, 2021
@petermetz @AzaharaC
fix(ci): github action runner disk full error hyperledger#641
f27d16b 
Added a docker resource pruning call to the
test case that was triggering the disk full issue
while pulling the Fabric AIO image necessary
for it's operation.

It is expected that this error will crop up in the future with different test cases and if and when that
happens we can add more of the same to
those tests as well, but for now, I did not want to
make this change to every single test case since
it wasn't strictly necessary and a better solution may
come along in the near future as well.

Fixes hyperledger#641

Signed-off-by: Peter Somogyvari <peter.somogyvari@accenture.com>
jordigiam pushed a commit to kikoncuo/cactus that referenced this issue Apr 8, 2021
@petermetz
fix(ci): github action runner disk full error hyperledger#641
a705355 
Added a docker resource pruning call to the
test case that was triggering the disk full issue
while pulling the Fabric AIO image necessary
for it's operation.

It is expected that this error will crop up in the future with different test cases and if and when that
happens we can add more of the same to
those tests as well, but for now, I did not want to
make this change to every single test case since
it wasn't strictly necessary and a better solution may
come along in the near future as well.

Fixes hyperledger#641

Signed-off-by: Peter Somogyvari <peter.somogyvari@accenture.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@petermetz petermetz

Labels
bug Something isn't working dependencies Pull requests that update a dependency file Developer_Experience Performance Everything related to how fast/efficient the software or it's tooling (e.g. build) is.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix(ci): github action runner disk full error #641 petermetz/cacti
1 participant
@petermetz