Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove distr prefix from macos builds #4766

Merged
merged 1 commit into from
Nov 29, 2023
Merged

Conversation

atalman
Copy link
Contributor

@atalman atalman commented Nov 28, 2023

MacOS smoke test started to fail with following error:

/opt/homebrew/Caskroom/miniconda/base/bin/conda run -p /Users/ec2-user/runner/_work/_temp/pytorch_pkg_helpers_7018156083_smoke conda install --quiet --yes -c pytorch-nightly -c file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr distr::torchvision

PackagesNotFoundError: The following packages are not available from current channels:

  - distr::torchvision

Current channels:

  - https://conda.anaconda.org/pytorch-nightly
  - file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr
  - defaults
  - https://conda.anaconda.org/distr <-- Here is the error

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org/

and use the search bar at the top of the page.

Hence removing distr channel produces expected result.
Please note: followup may be required to make sure file is actually installed from expected:
file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr
and not pytorch-nightly or pytorch-test

Copy link

vercel bot commented Nov 28, 2023

@atalman is attempting to deploy a commit to the Meta Open Source Team on Vercel.

A member of the Team first needs to authorize it.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 28, 2023
@atalman atalman changed the title Remove path overwriting for macos builds Remove distr prefix from macos builds Nov 29, 2023
@atalman atalman merged commit a098636 into pytorch:main Nov 29, 2023
11 of 12 checks passed
atalman added a commit to atalman/test-infra that referenced this pull request Nov 29, 2023
MacOS smoke test started to fail with following error:
```
/opt/homebrew/Caskroom/miniconda/base/bin/conda run -p /Users/ec2-user/runner/_work/_temp/pytorch_pkg_helpers_7018156083_smoke conda install --quiet --yes -c pytorch-nightly -c file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr distr::torchvision

PackagesNotFoundError: The following packages are not available from current channels:

  - distr::torchvision

Current channels:

  - https://conda.anaconda.org/pytorch-nightly
  - file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr
  - defaults
  - https://conda.anaconda.org/distr <-- Here is the error

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org/

and use the search bar at the top of the page.
```

Hence removing distr channel produces expected result.
Please note: followup may be required to make sure file is actually
installed from expected:
``
file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr
`` 
and not ``pytorch-nightly`` or ``pytorch-test``
atalman added a commit that referenced this pull request Nov 29, 2023
MacOS smoke test started to fail with following error:
```
/opt/homebrew/Caskroom/miniconda/base/bin/conda run -p /Users/ec2-user/runner/_work/_temp/pytorch_pkg_helpers_7018156083_smoke conda install --quiet --yes -c pytorch-nightly -c file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr distr::torchvision

PackagesNotFoundError: The following packages are not available from current channels:

  - distr::torchvision

Current channels:

  - https://conda.anaconda.org/pytorch-nightly
  - file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr
  - defaults
  - https://conda.anaconda.org/distr <-- Here is the error

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org/

and use the search bar at the top of the page.
```

Hence removing distr channel produces expected result. Please note:
followup may be required to make sure file is actually installed from
expected:
``
file:///Users/ec2-user/runner/_work/vision/vision/pytorch/vision/distr
``
and not ``pytorch-nightly`` or ``pytorch-test``
@malfet
Copy link
Contributor

malfet commented Nov 29, 2023

Please revert this change and file a bug against conda, as they should support local changes (or perhaps the syntax have changed)
Because yes, right now you are just testing nightly installation not the binary artifacts.
According to the conda install documentation, one can achieve the same guarantees by adding --strict-channel-priority option, i.e. conda install -c file://XYZ -c pytorch-nightly -c nvidia --strict-channel-priority pytorch-cuda=X.Y torchvision guarantees that channels are considered in order ...

atalman added a commit that referenced this pull request Nov 30, 2023
…l. (#4770)

Forward fix for: #4766

Related to issue: https://github.com/conda/conda/issues/13374

1. Make sure packages are searched in particular order during install.
Use override-channel option when installing packages for smoke test:
From Conda documentation:

https://docs.conda.io/projects/conda/en/latest/user-guide/concepts/channels.html#specifying-channels-when-installing-packages
```
From the command line use --c
You may specify multiple channels by passing the argument multiple times.
Priority decreases from left to right - the first argument is higher priority than the second.
From the command line use --override-channels to only search the specified channel(s),
 rather than any channels configured in .condarc.
```

2. Add check for validating that required package is actually installed
from required channel
atalman added a commit to atalman/test-infra that referenced this pull request Nov 30, 2023
…l. (pytorch#4770)

Forward fix for: pytorch#4766

Related to issue: https://github.com/conda/conda/issues/13374

1. Make sure packages are searched in particular order during install.
Use override-channel option when installing packages for smoke test:
From Conda documentation:

https://docs.conda.io/projects/conda/en/latest/user-guide/concepts/channels.html#specifying-channels-when-installing-packages
```
From the command line use --c
You may specify multiple channels by passing the argument multiple times.
Priority decreases from left to right - the first argument is higher priority than the second.
From the command line use --override-channels to only search the specified channel(s),
 rather than any channels configured in .condarc.
```

2. Add check for validating that required package is actually installed
from required channel
atalman added a commit that referenced this pull request Nov 30, 2023
#4771)

Forward fix for: #4766

Related to issue: https://github.com/conda/conda/issues/13374

1. Make sure packages are searched in particular order during install.
Use override-channel option when installing packages for smoke test:
From Conda documentation:


https://docs.conda.io/projects/conda/en/latest/user-guide/concepts/channels.html#specifying-channels-when-installing-packages
```
From the command line use --c
You may specify multiple channels by passing the argument multiple times.
Priority decreases from left to right - the first argument is higher priority than the second.
From the command line use --override-channels to only search the specified channel(s),
 rather than any channels configured in .condarc.
```

2. Add check for validating that required package is actually installed
from required channel
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants