Skip to content

Conversation

mthrok
Copy link
Contributor

@mthrok mthrok commented Oct 9, 2020

This PR resolves dependency issue of macOS unit test job setup step on release/0.7 branch.

It turns out that on macOS and Python 3.6 and 3.7 sox_effects.apply_effects_tensor and sox_effects.apply_effects_file get stuck when used in DataLoader with multiple workers.

Looks like it is related to OMP_NUM_THREADS and DataLoader. Filed the issue here -> pytorch/pytorch#46409 .

However notice that the way the CI jobs for PRs set up restricts to use PyTorch nightly build.
They might not be issue if the tests are ran with PyTorch RC 1.7.0. So I suggest to merge this PR first and let the CI job for release/0.7 run and see if the stuck still happens. Then resolve it in the later PR.

@mthrok mthrok force-pushed the fix-macos-ci branch 2 times, most recently from 6484e7a to 26c2d25 Compare October 14, 2020 20:34
@mthrok mthrok changed the base branch from master to release/0.7 October 14, 2020 21:10
@mthrok mthrok changed the title Fix macOS CI Unittest Fix macOS CI Unittest on release/0.7 Oct 14, 2020
@vincentqb
Copy link
Contributor

vincentqb commented Oct 16, 2020

If pytorch supported python 3.9 in 1.7 release (unfortunately doesn't, here), we could see if 3.9 also works, and this could give us some indication that issue may have been resolved on python side?

@mthrok mthrok changed the title Fix macOS CI Unittest on release/0.7 Resolve setup issue of macOS CI Unittest on release/0.7 Oct 16, 2020
@vincentqb
Copy link
Contributor

Do you know when the test started failing? The original pull request #760 was fine, here.

Copy link
Contributor

@vincentqb vincentqb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As I understand, this essentially disables caching on the branch release. LGTM.

@mthrok mthrok marked this pull request as ready for review October 19, 2020 17:52
@mthrok mthrok merged commit 49f4260 into pytorch:release/0.7 Oct 19, 2020
@mthrok mthrok deleted the fix-macos-ci branch October 19, 2020 17:52
@mthrok
Copy link
Contributor Author

mthrok commented Oct 19, 2020

thanks

mthrok pushed a commit to mthrok/audio that referenced this pull request Dec 13, 2022
Co-authored-by: Shen Li <shenli@devfair017.maas>
Co-authored-by: holly1238 <77758406+holly1238@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants