Out of space with alpine-last-latest-x64

[gengjiawen]

https://ci.nodejs.org/job/node-test-commit-linux/nodes=alpine-last-latest-x64/41702/console

14:53:49 --- Logging error ---
14:53:49 Traceback (most recent call last):
14:53:49   File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
14:53:49     self.flush()
14:53:49   File "/usr/lib/python3.8/logging/__init__.py", line 1065, in flush
14:53:49     self.stream.flush()
14:53:49 OSError: [Errno 28] No space left on device
14:53:49 Call stack:

[gengjiawen]

Also can space problem can be auto detected ?

[richardlau]

https://ci.nodejs.org/job/node-test-commit-linux/nodes=alpine-last-latest-x64/41702/ ran on the softlayer docker host so this is the same underlying issue as #2664 (as all the containers on that host share the same storage).

[richardlau]

Should be fixed now. I've resumed your build and alpine-last-latest appears to be running: https://ci.nodejs.org/job/node-test-commit-linux/41712/nodes=alpine-last-latest-x64/

Also can space problem can be auto detected ?

Yes. we're setting up grafana based monitoring and @AshCripps is also looking at Ansible Tower to make it easier to run remediation.

[richardlau]

Recent builds (including two on the SoftLayer container) are passing.