x/build: android and iOS corellium builders are missing #50299
It looks like these builders have gone missing recently. As visible at https://farmer.golang.org/#pools:
The text was updated successfully, but these errors were encountered:
(There is an iOS Corellium device that is experimenting on the deployment of iOS 15 which currently seems to fail due to code sign changes in iOS 15, but I haven't fully figured the reason, and not yet making it connect to farmer.golang.org. Hence two connected iOS devices.)
Rebooted some of them. Sadly they are all switched off for unknown reasons. See similar discussions in #51105.
There is one iOS device that cannot be rebooted due to a permanent kernel panic (which had observed more than 5 times now):
I am closing this because the Corellium builders are not missing as of #54246. If this happens again, we can always open another issue.
The reason that these builders were missing occasionally is identified as the VM reallocation effect on the Corellium side. In our case, when an associated VM is reallocated, these builders were destroyed, resulting in missing builders' observation.
Perhaps it would be better to have an email notification to the builder maintainer from farmer.golang.org when a builder is gone for 24 hours.