Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the Bug of Installing cuml by conda #3108

Closed
ShineCain opened this issue Nov 1, 2020 · 4 comments
Closed

the Bug of Installing cuml by conda #3108

ShineCain opened this issue Nov 1, 2020 · 4 comments
Labels
bug Something isn't working

Comments

@ShineCain
Copy link

For the cudf,cuxfilter, cuspatial, and cugraph tools, i can install them successfully, but when i use 'conda install -c rapidsai cuml=0.16', it reports that as follows:
Found conflicts! Looking for incompatible packages.failed
UnsatisfiableError: The following specifications were found to be incompatible with each other:
Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  • feature:/linux-64::__glibc==2.27=0
  • cuml=0.16 -> nccl[version='>=2.5'] -> __glibc[version='>=2.17']
    Your installed version is: 2.27

Environment details:

  • Linux Distro/Architecture: [Ubuntu 16.04 amd64]
  • GPU Model/Driver: [RTX 8000 and driver 450.80.82]
  • CUDA: 10.2
@ShineCain ShineCain added ? - Needs Triage Need team to review and classify bug Something isn't working labels Nov 1, 2020
@github-actions github-actions bot added this to Needs prioritizing in Bug Squashing Nov 1, 2020
@dantegd
Copy link
Member

dantegd commented Nov 2, 2020

Thanks for the issue @ShineCain. I think this might be an issue of needing additional channels in the command, particularly the nvidia conda channel, so I would recommend doing conda install -c rapidsai -c nvidia -c conda-forge cuml instead. Particularly, by omitting those channels, the dependency libcumlprims will not be found. I would recommend following the commands from the rapids.ai selector: https://rapids.ai/start.html#get-rapids

But beyond that, it it might be tricky to diagnose what is the issue with the info posted so far, so there are two things that can be helpful:

  1. Does it fail the same way if you install the whole rapids suite with the rapids meta package by doing
conda create -n rapids-0.16 -c rapidsai -c nvidia -c conda-forge \
    -c defaults rapids=0.16 cudatoolkit=10.2
  1. If all the above fails, could you run the script https://github.com/rapidsai/cuml/blob/branch-0.17/print_env.sh and add the information to the issue? We might be able to spot any issues from there.

Thanks!

@miroenev miroenev removed the ? - Needs Triage Need team to review and classify label Nov 2, 2020
@dantegd
Copy link
Member

dantegd commented Nov 16, 2020

Will close the issue for now due to inactivity, if any other conda installation issues arise feel free to re-open or open a new issue. Thanks!

@dantegd dantegd closed this as completed Nov 16, 2020
Bug Squashing automation moved this from Needs prioritizing to Closed Nov 16, 2020
@armstrys
Copy link

armstrys commented May 17, 2021

I am seeing a similar error with a conflict on __glibc even when running the rapids install command from the website with all channels listed. Below is the output from running that script. Let me know if I can provide any other info to help diagnose! For what it's worth, I was able to successfully install both cuspatial and run some operations with cudf on the same machine in an existing conda environment.

<details><summary>Click here to see environment details</summary><pre>
     
     **git***
     Not inside a git repository
     
     ***OS Information***
cat: /etc/upstream-release     DISTRIB_ID=LinuxMint
     DISTRIB_RELEASE=20.1
: Is a directory
     DISTRIB_CODENAME=ulyssa
     DISTRIB_DESCRIPTION="Linux Mint 20.1 Ulyssa"
     NAME="Linux Mint"
     VERSION="20.1 (Ulyssa)"
     ID=linuxmint
     ID_LIKE=ubuntu
     PRETTY_NAME="Linux Mint 20.1"
     VERSION_ID="20.1"
     HOME_URL="https://www.linuxmint.com/"
     SUPPORT_URL="https://forums.linuxmint.com/"
     BUG_REPORT_URL="http://linuxmint-troubleshooting-guide.readthedocs.io/en/latest/"
     PRIVACY_POLICY_URL="https://www.linuxmint.com/"
     VERSION_CODENAME=ulyssa
     UBUNTU_CODENAME=focal
     Linux nmi-fishbowl-armstrong 5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
     
     ***GPU Information***
     Mon May 17 07:41:48 2021
     +-----------------------------------------------------------------------------+
     | NVIDIA-SMI 460.73.01    Driver Version: 460.73.01    CUDA Version: 11.2     |
     |-------------------------------+----------------------+----------------------+
     | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
     | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
     |                               |                      |               MIG M. |
     |===============================+======================+======================|
     |   0  Quadro P4000        Off  | 00000000:01:00.0  On |                  N/A |
     | 50%   47C    P0    28W / 105W |    346MiB /  8111MiB |      0%      Default |
     |                               |                      |                  N/A |
     +-------------------------------+----------------------+----------------------+
     
     +-----------------------------------------------------------------------------+
     | Processes:                                                                  |
     |  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
     |        ID   ID                                                   Usage      |
     |=============================================================================|
     |    0   N/A  N/A      1164      G   /usr/lib/xorg/Xorg                180MiB |
     |    0   N/A  N/A      1777      G   cinnamon                           59MiB |
     |    0   N/A  N/A      2624      G   ...AAAAAAAAA= --shared-files       42MiB |
     |    0   N/A  N/A      3521      G   ...AAAAAAAAA= --shared-files       59MiB |
     +-----------------------------------------------------------------------------+
     WARNING: infoROM is corrupted at gpu 0000:01:00.0
     
     ***CPU***
     Architecture:                    x86_64
     CPU op-mode(s):                  32-bit, 64-bit
     Byte Order:                      Little Endian
     Address sizes:                   39 bits physical, 48 bits virtual
     CPU(s):                          16
     On-line CPU(s) list:             0-15
     Thread(s) per core:              2
     Core(s) per socket:              8
     Socket(s):                       1
     NUMA node(s):                    1
     Vendor ID:                       GenuineIntel
     CPU family:                      6
     Model:                           158
     Model name:                      Intel(R) Core(TM) i9-9900KF CPU @ 3.60GHz
     Stepping:                        12
     CPU MHz:                         3600.223
     CPU max MHz:                     5000.0000
     CPU min MHz:                     800.0000
     BogoMIPS:                        7200.00
     Virtualization:                  VT-x
     L1d cache:                       256 KiB
     L1i cache:                       256 KiB
     L2 cache:                        2 MiB
     L3 cache:                        16 MiB
     NUMA node0 CPU(s):               0-15
     Vulnerability Itlb multihit:     KVM: Vulnerable
     Vulnerability L1tf:              Not affected
     Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT vulnerable
     Vulnerability Meltdown:          Not affected
     Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
     Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
     Vulnerability Spectre v2:        Mitigation; Full generic retpoline, IBPB conditional, IBRS_FW, STIBP conditional, RSB filling
     Vulnerability Srbds:             Mitigation; Microcode
     Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT vulnerable
     Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d arch_capabilities
     
     ***CMake***
     
     ***g++***
     /usr/bin/g++
     g++ (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0
     Copyright (C) 2019 Free Software Foundation, Inc.
     This is free software; see the source for copying conditions.  There is NO
     warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
     
     
     ***nvcc***
     
     ***Python***
     
     ***Environment Variables***
     PATH                            : /home/ryan/miniconda3/condabin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
     LD_LIBRARY_PATH                 :
     NUMBAPRO_NVVM                   :
     NUMBAPRO_LIBDEVICE              :
     CONDA_PREFIX                    :
     PYTHON_PATH                     :
     
     ***conda packages***
     /home/ryan/miniconda3/condabin/conda
     # packages in environment at /home/ryan/miniconda3:
     #
     # Name                    Version                   Build  Channel
     _libgcc_mutex             0.1                 conda_forge    conda-forge
     _openmp_mutex             4.5                       1_gnu    conda-forge
     brotlipy                  0.7.0           py39h3811e60_1001    conda-forge
     ca-certificates           2020.12.5            ha878542_0    conda-forge
     certifi                   2020.12.5        py39hf3d152e_1    conda-forge
     cffi                      1.14.5           py39he32792d_0    conda-forge
     chardet                   4.0.0            py39hf3d152e_1    conda-forge
     conda                     4.10.1           py39hf3d152e_0    conda-forge
     conda-package-handling    1.7.3            py39h3811e60_0    conda-forge
     cryptography              3.4.7            py39hbca0aa6_0    conda-forge
     idna                      2.10               pyh9f0ad1d_0    conda-forge
     ld_impl_linux-64          2.35.1               hea4e1c9_2    conda-forge
     libffi                    3.3                  h58526e2_2    conda-forge
     libgcc-ng                 9.3.0               h2828fa1_19    conda-forge
     libgomp                   9.3.0               h2828fa1_19    conda-forge
     libstdcxx-ng              9.3.0               h6de172a_19    conda-forge
     ncurses                   6.2                  h58526e2_4    conda-forge
     openssl                   1.1.1k               h7f98852_0    conda-forge
     pip                       21.1.1             pyhd8ed1ab_0    conda-forge
     pycosat                   0.6.3           py39h3811e60_1006    conda-forge
     pycparser                 2.20               pyh9f0ad1d_2    conda-forge
     pyopenssl                 20.0.1             pyhd8ed1ab_0    conda-forge
     pysocks                   1.7.1            py39hf3d152e_3    conda-forge
     python                    3.9.2           hffdb5ce_0_cpython    conda-forge
     python_abi                3.9                      1_cp39    conda-forge
     readline                  8.1                  h46c0cb4_0    conda-forge
     requests                  2.25.1             pyhd3deb0d_0    conda-forge
     ruamel_yaml               0.15.80         py39h3811e60_1004    conda-forge
     setuptools                49.6.0           py39hf3d152e_3    conda-forge
     six                       1.16.0             pyh6c4a22f_0    conda-forge
     sqlite                    3.35.5               h74cdb3f_0    conda-forge
     tk                        8.6.10               h21135ba_1    conda-forge
     tqdm                      4.60.0             pyhd8ed1ab_0    conda-forge
     tzdata                    2021a                he74cb21_0    conda-forge
     urllib3                   1.26.4             pyhd8ed1ab_0    conda-forge
     wheel                     0.36.2             pyhd3deb0d_0    conda-forge
     xz                        5.2.5                h516909a_1    conda-forge
     yaml                      0.2.5                h516909a_0    conda-forge
     zlib                      1.2.11            h516909a_1010    conda-forge
     
</pre></details>

@mshlis
Copy link

mshlis commented May 20, 2022

Any update on this? Getting similar issues on more current version:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.31=0
  - feature:|@/linux-64::__glibc==2.31=0
  - cuml -> cupy[version='>=7.8.0,<11.0.0a0'] -> __glibc[version='>=2.17|>=2.17,<3.0.a0']

Your installed version is: 2.31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Development

No branches or pull requests

5 participants