conda-build python 3.8 issue with cuda driver.

[weinbe58]

I'm running a linux-64 build for my package QuSpin

Actual Behavior

This issue happens after running conda build --no-anaconda-upload ./conda.recipe in the top directory of my repo.

I should mention that this package makes no use of cuda directly in the code it only comes in from Numba if I had to guess.

During the first part of the build matrix, namely for python 3.8, the build fails to render and I get conflicts but during the output for the conflicts there is another exception so the output does not get to finish.

Expected Behavior

I would expect that the build runs normally, either giving me some issues due to conflicts in the recipe or just finish the build.

Steps to Reproduce

git clone https://github.com/weinbe58/QuSpin.git
cd QuSpin
condo build --no-anaconda-upload ./conda.recipe

gives the following output:

No numpy version specified in conda_build_config.yaml.  Falling back to default numpy value of 1.11
WARNING:conda_build.metadata:No numpy version specified in conda_build_config.yaml.  Falling back to default numpy value of 1.11
Adding in variants from internal_defaults
INFO:conda_build.variants:Adding in variants from internal_defaults
Adding in variants from /home/phillip/Documents/ED_python/sources/QuSpin/conda.recipe/quspin/conda_build_config.yaml
INFO:conda_build.variants:Adding in variants from /home/phillip/Documents/ED_python/sources/QuSpin/conda.recipe/quspin/conda_build_config.yaml
Attempting to finalize metadata for quspin
INFO:conda_build.metadata:Attempting to finalize metadata for quspin
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
failed                                                                                                                                                        

Leaving build/test directories:
  Work:
 /home/phillip/anaconda3/conda-bld/work 
  Test:
 /home/phillip/anaconda3/conda-bld/test_tmp 
Leaving build/test environments:
  Test:
source activate  /home/phillip/anaconda3/conda-bld/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold 
  Build:
source activate  /home/phillip/anaconda3/conda-bld/_build_env 


Traceback (most recent call last):
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/environ.py", line 757, in get_install_actions
    actions = install_actions(prefix, index, specs, force=True)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
    return f(*args, **kwds)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/plan.py", line 474, in install_actions
    txn = solver.solve_for_transaction(prune=prune, ignore_pinned=not pinned)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/core/solve.py", line 117, in solve_for_transaction
    should_retry_solve)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/core/solve.py", line 158, in solve_for_diff
    force_remove, should_retry_solve)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/core/solve.py", line 281, in solve_final_state
    ssc = self._run_sat(ssc)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
    return f(*args, **kwds)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/core/solve.py", line 808, in _run_sat
    should_retry_solve=ssc.should_retry_solve
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
    return f(*args, **kwds)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/resolve.py", line 1318, in solve
    self.find_conflicts(specs, specs_to_add, history_specs)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda/resolve.py", line 351, in find_conflicts
    raise UnsatisfiableError(bad_deps, strict=strict_channel_priority)
conda.exceptions.UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versions

Package ca-certificates conflicts for:
boost -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
cython -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
python=3.8 -> openssl[version='>=1.1.1e,<1.1.2a'] -> ca-certificates

Package setuptools conflicts for:
cython -> setuptools
python=3.8 -> pip -> setuptools

Package python conflicts for:
boost -> python[version='>=2.7,<2.8.0a0|>=3.5,<3.6.0a0|>=3.8,<3.9.0a0|>=3.7,<3.8.0a0|>=3.6,<3.7.0a0']
numpy=1.17.2 -> mkl-service[version='>=2,<3.0a0'] -> python[version='>=2.7,<2.8.0a0|>=3.8,<3.9.0a0|>=3.5,<3.6.0a0']
cython -> python[version='>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.8,<3.9.0a0|>=3.5,<3.6.0a0']
python=3.8
numpy=1.17.2 -> python[version='>=3.6,<3.7.0a0|>=3.7,<3.8.0a0']

Package numpy conflicts for:
numpy=1.17.2
boost -> py-boost==1.71.0=py38h962f231_0 -> numpy[version='>=1.11.3,<2.0a0|>=1.9.3,<2.0a0']

Package _libgcc_mutex conflicts for:
numpy=1.17.2 -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
python=3.8 -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
cython -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]The following specifications were found to be incompatible with your CUDA driver:

  - feature:/linux-64::__cuda==9.1=0
  - feature:|@/linux-64::__cuda==9.1=0

Your installed CUDA driver is: 9.1


During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/phillip/anaconda3/bin/conda-build", line 11, in <module>
    sys.exit(main())
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/cli/main_build.py", line 469, in main
    execute(sys.argv[1:])
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/cli/main_build.py", line 460, in execute
    verify=args.verify, variants=args.variants)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/api.py", line 209, in build
    notest=notest, need_source_download=need_source_download, variants=variants)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/build.py", line 2344, in build_tree
    notest=notest,
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/build.py", line 1335, in build
    output_metas = expand_outputs([(m, need_source_download, need_reparse_in_env)])
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/render.py", line 746, in expand_outputs
    for (output_dict, m) in _m.copy().get_output_metadata_set(permit_unsatisfiable_variants=False):
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/metadata.py", line 2048, in get_output_metadata_set
    bypass_env_check=bypass_env_check)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/metadata.py", line 719, in finalize_outputs_pass
    parent_metadata.parse_until_resolved()
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/metadata.py", line 1018, in parse_until_resolved
    bypass_env_check=bypass_env_check)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/metadata.py", line 940, in parse_again
    bypass_env_check=bypass_env_check),
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/metadata.py", line 1528, in _get_contents
    rendered = template.render(environment=env)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "/home/phillip/Documents/ED_python/sources/QuSpin/conda.recipe/quspin/meta.yaml", line 30, in top-level template code
    - {{ pin_compatible('numpy') }} 
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/jinja_context.py", line 230, in pin_compatible
    pins, _, _ = get_env_dependencies(m, 'host', m.config.variant)
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/render.py", line 154, in get_env_dependencies
    channel_urls=tuple(m.config.channel_urls))
  File "/home/phillip/anaconda3/lib/python3.7/site-packages/conda_build/environ.py", line 759, in get_install_actions
    raise DependencyNeedsBuildingError(exc, subdir=subdir)
conda_build.exceptions.DependencyNeedsBuildingError: Unsatisfiable dependencies for platform linux-64: {'feature:/linux-64::__cuda==9.1=0', 'feature:|@/linux-64::__cuda==9.1=0'}

Output of conda info

     active environment : py38
    active env location : /home/phillip/anaconda3/envs/py38
            shell level : 2
       user config file : /home/phillip/.condarc
 populated config files : /home/phillip/.condarc
          conda version : 4.8.3
    conda-build version : 3.18.11
         python version : 3.7.7.final.0
       virtual packages : __cuda=9.1
                          __glibc=2.27
       base environment : /home/phillip/anaconda3  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/phillip/anaconda3/pkgs
                          /home/phillip/.conda/pkgs
       envs directories : /home/phillip/anaconda3/envs
                          /home/phillip/.conda/envs
               platform : linux-64
             user-agent : conda/4.8.3 requests/2.23.0 CPython/3.7.7 Linux/4.15.0-96-generic ubuntu/18.04.4 glibc/2.27
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False

[mingwandroid]

This is a conda issue, would you agree @kalefranz ?

[sodre]

I am experiencing a similar issue on an almost brand-new box with conda install using the .deb files.

conda install conda-build:

root@despair:~# conda install conda-build
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: - 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
failed                                                                                                         

UnsatisfiableError: The following specifications were found
to be incompatible with the existing python installation in your environment:

Specifications:

  - conda-build -> python[version='>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.5,<3.6.0a0']

Your python: python=3.8

If python is on the left-most side of the chain, that's the version you've asked for.
When python appears to the right, that indicates that the thing on the left is somehow
not available for the python version you are constrained to. Note that conda will not
change your python version to a different minor version unless you explicitly specify
that.

The following specifications were found to be incompatible with your CUDA driver:

  - feature:/linux-64::__cuda==10.2=0
  - feature:|@/linux-64::__cuda==10.2=0

Your installed CUDA driver is: 10.2


root@despair:~# 

If it helps, the error does not happen if I install conda-build from conda-forge.

conda install conda-forge::conda-build

root@despair:~# conda install conda-forge::conda-build                                                                                                                                                             
Collecting package metadata (current_repodata.json): done                                                                                                                                                          
Solving environment: failed with initial frozen solve. Retrying with flexible solve.                                                                                                                               
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.                                                                                                        
Collecting package metadata (repodata.json): done                                                                                                                                                                  
Solving environment: done                                                                                                                                                                                          
                                                                                                                                                                                                                   
## Package Plan ##                                                                                                                                                                                                 
                                                                                                                                                                                                                   
  environment location: /opt/conda                                                                                                                                                                                 
                                                                                                                                                                                                                   
  added / updated specs:                                                                                                                                                                                           
    - conda-forge::conda-build                                                                                                                                                                                     
                                                                                                                                                                                                                   
                                                                                                                                                                                                                   
The following packages will be downloaded:                                                                                                                                                                         
                                                                                                                                                                                                                   
    package                    |            build                                                                                                                                                                  
    ---------------------------|-----------------                                                                                                                                                                  
    beautifulsoup4-4.9.0       |           py38_0         167 KB  defaults                                                                                                                                         
    bzip2-1.0.8                |       h7b6447c_0          78 KB  defaults                                                                                                                                         
    conda-build-3.18.11        |           py38_0         515 KB  conda-forge                                                                                                                                      
    filelock-3.0.12            |             py_0          13 KB  defaults                                                                                                                                         
    glob2-0.7                  |             py_0          15 KB  defaults                                                                                                                                         
    jinja2-2.11.2              |             py_0         103 KB  defaults                                                                                                                                         
    libarchive-3.3.3           |       h5d8350f_5         725 KB  defaults                                                                                                                                         
    liblief-0.10.1             |       he6710b0_0         1.7 MB  defaults                                                                                                                                         
    libxml2-2.9.9              |       hea5a465_1         1.6 MB  defaults
    lz4-c-1.8.1.2              |       h14c3975_0         130 KB  defaults
    lzo-2.10                   |       h7b6447c_2         184 KB  defaults
    markupsafe-1.1.1           |   py38h7b6447c_0          33 KB  defaults
    patchelf-0.10              |       he6710b0_0          74 KB  defaults
    pkginfo-1.5.0.1            |           py38_0          43 KB  defaults
    psutil-5.7.0               |   py38h7b6447c_0         321 KB  defaults
    py-lief-0.10.1             |   py38h403a769_0         1.0 MB  defaults
    python-libarchive-c-2.9    |             py_0          46 KB  defaults
    ripgrep-11.0.2             |       he32d670_0         1.3 MB  defaults
    soupsieve-2.0              |             py_0          33 KB  defaults
    zstd-1.3.7                 |       h0b5b093_0         401 KB  defaults
    ------------------------------------------------------------
                                           Total:         8.3 MB

The following NEW packages will be INSTALLED:

  beautifulsoup4     pkgs/main/linux-64::beautifulsoup4-4.9.0-py38_0
  bzip2              pkgs/main/linux-64::bzip2-1.0.8-h7b6447c_0
  conda-build        conda-forge/linux-64::conda-build-3.18.11-py38_0
  filelock           pkgs/main/noarch::filelock-3.0.12-py_0
  glob2              pkgs/main/noarch::glob2-0.7-py_0
  jinja2             pkgs/main/noarch::jinja2-2.11.2-py_0
  libarchive         pkgs/main/linux-64::libarchive-3.3.3-h5d8350f_5
  liblief            pkgs/main/linux-64::liblief-0.10.1-he6710b0_0
  libxml2            pkgs/main/linux-64::libxml2-2.9.9-hea5a465_1
  lz4-c              pkgs/main/linux-64::lz4-c-1.8.1.2-h14c3975_0
  lzo                pkgs/main/linux-64::lzo-2.10-h7b6447c_2
  markupsafe         pkgs/main/linux-64::markupsafe-1.1.1-py38h7b6447c_0
  patchelf           pkgs/main/linux-64::patchelf-0.10-he6710b0_0
  pkginfo            pkgs/main/linux-64::pkginfo-1.5.0.1-py38_0
  psutil             pkgs/main/linux-64::psutil-5.7.0-py38h7b6447c_0
  py-lief            pkgs/main/linux-64::py-lief-0.10.1-py38h403a769_0
  python-libarchive~ pkgs/main/noarch::python-libarchive-c-2.9-py_0
  pytz               pkgs/main/noarch::pytz-2020.1-py_0
  pyyaml             pkgs/main/linux-64::pyyaml-5.3.1-py38h7b6447c_0
  ripgrep            pkgs/main/linux-64::ripgrep-11.0.2-he32d670_0
  soupsieve          pkgs/main/noarch::soupsieve-2.0-py_0
  zstd               pkgs/main/linux-64::zstd-1.3.7-h0b5b093_0

The following packages will be UPDATED:

  certifi                                 2019.11.28-py38_1 --> 2020.4.5.1-py38_0
  openssl                                 1.1.1e-h7b6447c_0 --> 1.1.1g-h7b6447c_0


Proceed ([y]/n)? n


CondaSystemExit: Exiting.

root@despair:~# 

conda info output

root@despair:~# conda info

     active environment : None
            shell level : 0
       user config file : /root/.condarc
 populated config files : /opt/conda/.condarc
          conda version : 4.8.3
    conda-build version : not installed
         python version : 3.8.1.final.0
       virtual packages : __cuda=10.2
                          __glibc=2.27
       base environment : /opt/conda  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /opt/conda/pkgs
                          /root/.conda/pkgs
       envs directories : /opt/conda/envs
                          /root/.conda/envs
               platform : linux-64
             user-agent : conda/4.8.3 requests/2.23.0 CPython/3.8.1 Linux/4.15.0-1080-oem ubuntu/18.04.4 glibc/2.27
                UID:GID : 0:0
             netrc file : None
           offline mode : False

root@despair:~# 

[sodre]

I did a little bit more digging.... I think the solver is failing because there is no conda-build build for python=3.8 for osx or linux on the anaconda channel.

[s22chan]

This is basically the same issue as #3956

[github-actions]

Hi there, thank you for your contribution!

This issue has been automatically marked as stale because it has not had recent activity. It will be closed automatically if no further activity occurs.

If you would like this issue to remain open please:

1. Verify that you can still reproduce the issue at hand
2. Comment that the issue is still reproducible and include:
   - What OS and version you reproduced the issue on
   - What steps you followed to reproduce the issue

NOTE: If this issue was closed prematurely, please leave a comment.

Thanks!