Xcode 15.2 on macos-14 image can not run the Apple Vision Pro simulator for testing, while other Apple platform (like iOS/tvOS/macOS) works

[dreampiggy]

Describe the bug

About me: I'm testing iOS/tvOS/visionOS/macOS SDK on the GitHub runner, here: https://github.com/SDWebImage/SDWebImage/actions/runs/8029051513

Background

I recently switch from macos-13 Intel based runner image into the arm64 macos-14 one, and found a strange issue.

For macos-13, since it's Intel based, and does not has visionOS SDK and simulator installed, so I use the tricks from community:

      - name: Prepare VisionOS
        run: |
          defaults write com.apple.dt.Xcode AllowUnsupportedVisionOSHost -bool YES
          defaults write com.apple.CoreSimulator AllowUnsupportedVisionOSHost -bool YES
          xcodebuild -downloadPlatform visionOS

It used to work.

Current status

However, when switch into the macos-14 arm based machine. I remove the tricks above ⬆️ because the visionOS toolchain is already installed in Xcode 15.2 on arm based machine.

So, I choose to just run the test case, it will run the following command on GitHub runner

xcodebuild test-without-building -workspace "SDWebImage.xcworkspace" -scheme "Tests Vision" -configuration Debug -destination "platform=visionOS Simulator,name=Apple Vision Pro" CODE_SIGNING_ALLOWED=NO

However, the test seems never booted, it just suck and wait for 30 minutes then timeout. I have to cancel the job by myself.

From the link I provided https://github.com/SDWebImage/SDWebImage/actions/runs/8029051513, You can see, other jobs (iOS/macOS/tvOS) run the similar command and just work.

Only the Apple Vision Simulator will suck and no output at all. It will suck for 30 minutes and I have to cancel itself.

My Local test

I have a macOS 13.5 running on Apple MacBook Pro 13 (M1 Pro chip), and running the command, it just run succfully.

Note that Testing started in stdout.

However, only GitHub runner will suck without any extra output.

Possible Reason

Because I can not log-on the GitHub runner VM Mac machine, so I can not understand what's actually happended. Is this something like a GUI alert poped-up which breaks the xcodebuild test command to continue ?

Or, maybe something about the compatible issue Xcode 15's Apple Vision Pro Simulator on GitHub action. Which can not been booted at all. (But however, I try to use xcrun simctl boot "Apple Vision Pro" on GitHub action, it returns 0 and success.)

To Reproduce
Steps to reproduce the behavior:

1. Goto https://github.com/dreampiggy/SDWebImage/tree/ci/vision (this is fork repo)
2. Create a PR to the https://github.com/dreampiggy/SDWebImage, target branch is master (Or simple, just click https://github.com/SDWebImage/SDWebImage/compare/master...dreampiggy:SDWebImage:ci/vision?expand=1)
3. See the GitHub runner running status, it will suck as Unit Test (visionOS) job, but all other jobs will pass.

Expected behavior
The Github Runner image macos-14 should works when running xcodebuild test command for Apple Vision Pro simulator. Just like local Mac environment.

Runner Version and Platform

Image: macos-14

What's not working?

See above in issue descrption, the Github Runner suck at xcodebuild test on Apple Vision Pro simulator only, not other platforms.

Job Log Output

Download here: https://github.com/SDWebImage/SDWebImage/actions/runs/8029051513

logs_630.zip

Runner and Worker's Diagnostic Logs

See above ⬆️

[benwells]

👋 Thanks for the report! This looks like an issue with the underlying hosted runner image for macos-14, not so much the runner application itself. Going to transfer to https://github.com/actions/runner-images so the appropriate team can take a look.