Skip to content

Conversation

@jathu
Copy link
Contributor

@jathu jathu commented Mar 18, 2025

Summary

As part of #9019, this will allow us to test CoreML support for wheels.

Why are we only selectively running the executor test?

Our macos-*-stable runners do not have xcode, which is required to build and run these tests. Only GitHub's macos-*-xlarge runners have xcode. We currently run these CoreML tests on trunk, which would be way too expensive to use GitHub's runner given the frequency. So let's limit the runner tests to just the wheel jobs. I will work with Test Infra to get Xcode into our runners.

Test plan

  • Wheel tests shouldn't change
  • Test locally
$ GITHUB_WORKSPACE=$(dirname $(pwd)) REPOSITORY=$(basename $(pwd)) python .ci/scripts/wheel/test_macos.py

@pytorch-bot
Copy link

pytorch-bot bot commented Mar 18, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/9381

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Pending, 1 Unrelated Failure

As of commit 51e3e3a with merge base 01a22b6 (image):

NEW FAILURE - The following job has failed:

UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 18, 2025
@jathu jathu force-pushed the jathu/wheel-test-others branch from 9a927f3 to fee3327 Compare March 18, 2025 23:45
@jathu jathu force-pushed the jathu/wheel-test-others branch from fee3327 to 22fd470 Compare March 19, 2025 00:11
@jathu jathu marked this pull request as ready for review March 19, 2025 00:11
@jathu jathu requested review from jackzhxng and lucylq as code owners March 19, 2025 00:11
@jathu jathu force-pushed the jathu/wheel-test-others branch 2 times, most recently from 8accd11 to e2fadc9 Compare March 19, 2025 15:44
@jathu jathu force-pushed the jathu/wheel-test-others branch from e2fadc9 to f81864e Compare March 19, 2025 15:46
@jathu jathu marked this pull request as draft March 19, 2025 16:08
@jathu jathu force-pushed the jathu/wheel-test-others branch 5 times, most recently from 7aa10d0 to 72f336a Compare March 19, 2025 17:18
@jathu jathu force-pushed the jathu/wheel-test-others branch 2 times, most recently from a0248a0 to caae5ef Compare March 19, 2025 18:00
@jathu jathu marked this pull request as ready for review March 19, 2025 18:32
@jathu jathu force-pushed the jathu/wheel-test-others branch from caae5ef to 51e3e3a Compare March 19, 2025 18:44
@jathu jathu merged commit e0235f0 into main Mar 19, 2025
247 of 252 checks passed
@jathu jathu deleted the jathu/wheel-test-others branch March 19, 2025 20:16
oscarandersson8218 pushed a commit to oscarandersson8218/executorch that referenced this pull request Mar 21, 2025
)

### Summary
As part of pytorch#9019, this will
allow us to test CoreML support for wheels.

#### Why are we only selectively running the executor test? 

Our `macos-*-stable` runners do not have xcode, which is required to
build and run these tests. Only GitHub's `macos-*-xlarge` runners have
xcode. We currently run these CoreML tests on
[trunk](https://github.com/pytorch/executorch/blob/7c6d2f332861907391450974a481b6d8e04732ed/.github/workflows/trunk.yml#L444-L477),
which would be way too expensive to use GitHub's runner given the
frequency. So let's limit the runner tests to just the wheel jobs. I
will work with Test Infra to get Xcode into our runners.

### Test plan

* Wheel tests shouldn't change
* Test locally

```bash
$ GITHUB_WORKSPACE=$(dirname $(pwd)) REPOSITORY=$(basename $(pwd)) python .ci/scripts/wheel/test_macos.py
```
DannyYuyang-quic pushed a commit to CodeLinaro/executorch that referenced this pull request Apr 2, 2025
)

### Summary
As part of pytorch#9019, this will
allow us to test CoreML support for wheels.

#### Why are we only selectively running the executor test? 

Our `macos-*-stable` runners do not have xcode, which is required to
build and run these tests. Only GitHub's `macos-*-xlarge` runners have
xcode. We currently run these CoreML tests on
[trunk](https://github.com/pytorch/executorch/blob/7c6d2f332861907391450974a481b6d8e04732ed/.github/workflows/trunk.yml#L444-L477),
which would be way too expensive to use GitHub's runner given the
frequency. So let's limit the runner tests to just the wheel jobs. I
will work with Test Infra to get Xcode into our runners.

### Test plan

* Wheel tests shouldn't change
* Test locally

```bash
$ GITHUB_WORKSPACE=$(dirname $(pwd)) REPOSITORY=$(basename $(pwd)) python .ci/scripts/wheel/test_macos.py
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: not user facing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants