[macOS] Xcode 16.4 sometimes missing simulators #12948
Description
Description
Just noticed that macos-15-arm64 runner image version 20250830.2281 is missing basically all simulators, this caused one of our CI build to fail.
Note
After re-running using the same image & version, the simulators showed up as expected, passing CI.
Platforms affected
- Azure DevOps
- GitHub Actions - Standard Runners
- GitHub Actions - Larger Runners
Runner images affected
- Ubuntu 22.04
- Ubuntu 24.04
- macOS 13
- macOS 13 Arm64
- macOS 14
- macOS 14 Arm64
- macOS 15
- macOS 15 Arm64
- Windows Server 2019
- Windows Server 2022
- Windows Server 2025
Image version and build link
Setup
Current runner version: '2.328.0'
Runner Image Provisioner
Hosted Compute Agent
Version: 20250829.383
Commit: 27cb235aab5b0e52e153a26cd86b4742e89dac5d
Build Date: 2025-08-29T13:48:48Z
Operating System
Runner Image
Image: macos-15-arm64
Version: 20250830.2281
Included Software: https://github.com/actions/runner-images/blob/macos-15-arm64/20250830.2281/images/macos/macos-15-arm64-Readme.md
Image Release: https://github.com/actions/runner-images/releases/tag/macos-15-arm64%2F20250830.2281
Select Xcode & check version
sudo xcode-select -switch /Applications/Xcode_16.4.app
/usr/bin/xcodebuild -version
shell: /bin/bash -e {0}
Xcode 16.4
Build version 16F6
List simulators
Run xcrun simctl list devices available
xcrun simctl list devices available
shell: /bin/bash -e {0}
== Devices ==
-- iOS 18.4 --
-- iOS 18.5 --
-- iOS 18.6 --
-- tvOS 18.2 --
-- tvOS 18.4 --
-- tvOS 18.5 --
-- watchOS 11.2 --
-- watchOS 11.4 --
-- watchOS 11.5 --
-- visionOS 2.3 --
Apple Vision Pro (F2DB3FCB-A2AE-4CF9-9B0B-7BA9E04DD214) (Shutdown)
-- visionOS 2.4 --
Apple Vision Pro (E2DAB2BD-C800-4E02-B7A9-8E257C6D1A71) (Shutdown)
-- visionOS 2.5 --
Apple Vision Pro (FF6309F0-CE11-4DC8-A131-EB58ADD83ADF) (Shutdown)
GHA script
build-and-test:
runs-on: macos-15
steps:
- uses: actions/checkout@v4
- name: List Xcodes
run: ls /Applications
- name: Select Xcode
run: sudo xcode-select -switch /Applications/Xcode_16.4.app
- name: Xcode version
run: /usr/bin/xcodebuild -version
- name: List available simulators
run: xcrun simctl list devices available
...
Is it regression?
No
Expected behavior
xcrun simctl list devices available should include iOS devices..
In the second CI run it showed up correctly:
xcrun simctl list devices available
shell: /bin/bash -e {0}
== Devices ==
-- iOS 18.4 --
iPhone 16 Pro (0E573B10-C4F3-40D6-A8CB-08B18F25CE08) (Shutdown)
iPhone 16 Pro Max (7CBD1399-417F-4AB9-A1FF-2D655880A119) (Shutdown)
...
-- iOS 18.5 --
iPhone 16 Pro (7A792E32-B159-474E-9815-4140411E029D) (Shutdown)
iPhone 16 Pro Max (14FE211B-FBA6-4A10-A32E-4E9602F4E353) (Shutdown)
...
-- iOS 18.6 --
iPhone 16 Pro (AB1BB0F9-7AEB-4FD1-BA2E-1CE6A82AF8EC) (Shutdown)
iPhone 16 Pro Max (A7A69EC3-B495-486E-B3A7-646A04A23C97) (Shutdown)
iPhone 16e (434B0638-4BF4-48D8-A24C-0CB45DB1995B) (Shutdown)
iPhone 16 (003BA064-E7F6-4A16-8395-C3AADA4AA946) (Shutdown)
Actual behavior
Only Vision Pro / VisionOS simulators are returned (see logs above).
Repro steps
As mentioned, another commit and subsequent re-run using the exact same config seems to work fine. Just thought to report this in case it comes up again..
- possibly related to: [macos-15] iOS build fails on CI due to incorrect SDK targeting #12758 (comment)