Installation issue: Cannot concretize ecp-proxy-apps

[EmreAtes]

Steps to reproduce the issue

[eates@nid00020 ~/spack/bin]$ ./spack install ecp-proxy-apps
==> Warning: Could not detect module function from bash. Trying to detect modulecmd from `which`
==> Warning: Could not detect module function from bash. Trying to detect modulecmd from `which`
==> Error: Multiple providers found for 'gl': ['mesa@18.1.2%gcc@7.3.0~hwrender~llvm+swrender arch=cray-cnl6-haswell  ^binutils@2.31.1%gcc@7.3.0+gold~libiberty+nls~plugins arch=cray-cnl6-haswell  ^bison@3.0.5%gcc@7.3.0 arch=cray-cnl6-haswell  ^bzip2@1.0.6%gcc@7.3.0+shared arch=cray-cnl6-haswell  ^damageproto@1.1: ^expat@2.2.5%gcc@7.3.0+libbsd arch=cray-cnl6-haswell  ^fixesproto@5.0: ^flex@2.6.3%gcc@7.3.0+lex arch=cray-cnl6-haswell  ^gdbm@1.14.1%gcc@7.3.0 arch=cray-cnl6-haswell  ^gettext@0.19.8.1%gcc@7.3.0+bzip2+curses+git~libunistring+libxml2+tar+xz arch=cray-cnl6-haswell  ^glproto@1.4.14: ^help2man@1.47.4%gcc@7.3.0 arch=cray-cnl6-haswell  ^icu4c@60.1%gcc@7.3.0 arch=cray-cnl6-haswell  ^inputproto@2.3.2%gcc@7.3.0 arch=cray-cnl6-haswell  ^kbproto@1.0.7%gcc@7.3.0 arch=cray-cnl6-haswell  ^libbsd ^libpthread-stubs@0.4%gcc@7.3.0 arch=cray-cnl6-haswell  ^libsigsegv@2.11%gcc@7.3.0 arch=cray-cnl6-haswell  ^libx11@1.6.5%gcc@7.3.0 arch=cray-cnl6-haswell  ^libxau@1.0.8%gcc@7.3.0 arch=cray-cnl6-haswell  ^libxcb@1.13%gcc@7.3.0 arch=cray-cnl6-haswell  ^libxdamage ^libxdmcp@1.1.2%gcc@7.3.0 arch=cray-cnl6-haswell  ^libxext ^libxfixes ^libxml2@2.9.8%gcc@7.3.0~python arch=cray-cnl6-haswell  ^libxshmfence@1.1: ^libxv ^libxvmc ^m4@1.4.18%gcc@7.3.0+sigsegv arch=cray-cnl6-haswell  ^ncurses@6.1%gcc@7.3.0~symlinks~termlib arch=cray-cnl6-haswell  ^openssl@1.0.2o%gcc@7.3.0+systemcerts arch=cray-cnl6-haswell  ^perl@5.26.2%gcc@7.3.0+cpanm+shared+threads arch=cray-cnl6-haswell  ^pkgconf@1.4.2%gcc@7.3.0 arch=cray-cnl6-haswell  ^presentproto@1.0: ^py-mako@1.0.4%gcc@7.3.0 arch=cray-cnl6-haswell  ^py-markupsafe@1.0%gcc@7.3.0 arch=cray-cnl6-haswell  ^py-setuptools@40.2.0%gcc@7.3.0 arch=cray-cnl6-haswell  ^python@3.6%gcc@7.3.0+dbm~optimizations+pic+pythoncmd+shared~tk~ucs4 arch=cray-cnl6-haswell  ^readline@7.0%gcc@7.3.0 arch=cray-cnl6-haswell  ^tar ^util-macros@1.19.1%gcc@7.3.0 arch=cray-cnl6-haswell  ^videoproto ^xcb-proto@1.13%gcc@7.3.0 arch=cray-cnl6-haswell  ^xextproto@7.3.0%gcc@7.3.0 arch=cray-cnl6-haswell  ^xproto@7.0.31%gcc@7.3.0 arch=cray-cnl6-haswell  ^xtrans@1.3.5%gcc@7.3.0 arch=cray-cnl6-haswell  ^xz@5.2.4%gcc@7.3.0 arch=cray-cnl6-haswell  ^zlib@1.2.11%gcc@7.3.0+optimize+pic+shared arch=cray-cnl6-haswell', 'opengl']

Platform and user environment

Please report your OS here:

[eates@nid00020 ~/spack/bin]$ uname -a
Linux nid00020 4.4.73-5.1_4.0.141-cray_ari_c #1 SMP Mon Mar 12 17:11:28 UTC 2018 (4.0.141) x86_64 x86_64 x86_64 GNU/Linux
[eates@nid00020 ~/spack/bin]$ lsb_release -d
Description:    SUSE Linux Enterprise Server 12 SP3

Additional information

I've managed to narrow the problem down a little. Among the dependencies for ecp-proxy-apps, only candle-benchmarks is having a problem, which comes down to depending on opencv. At /var/spack/repos/builtin/packages/candle-benchmarks/package.py:47 The benchmark depends on opencv@3.2.0: +core +highgui +imgproc +jpeg +png +tiff +zlib +python -dnn ~eigen, which also fails to spec.

I can successfully install mesa using spack, so I'm not sure where the problem comes from.

There's also an old version of mesa installed in /usr/, which I've tried adding to packages.yaml, like #7986 but it doesn't change the error message that much.

[eates@nid00020 ~/spack/bin]$ cat ~/.spack/packages.yaml
packages:
... more stuff here ...
  mesa:
    paths:
      mesa: /usr/
    buildable: False
  mpich:
    modules:
      mpich: cray-mpich
    buildable: False
  all:
    providers:
      gl: [mesa]
      mpi: [mpich]

[eates@nid00020 ~/spack/bin]$ ./spack install opencv@3.2.0:+core+highgui+imgproc+jpeg+png+tiff+zlib+python~dnn~eigen
==> Warning: Could not detect module function from bash. Trying to detect modulecmd from `which`
==> Warning: Could not detect module function from bash. Trying to detect modulecmd from `which`
==> Error: Multiple providers found for 'gl': ['mesa@18.1.2%gcc@7.3.0~hwrender~llvm+swrender arch=cray-cnl6-haswell', 'opengl']

I've looked at #8133 and #7901 but it didn't resolve my issue.

[scheibelp]

The following works for me:

spack spec ecp-proxy-apps ^libjpeg ^python@3: ^vtk+osmesa ^mesa

• The vtk package requires opengl if the osmesa variant is deactivated (~osmesa), which is true by default
• Some package in the dependency tree explicitly requests libjpeg
• The reasons for Spack making these sorts of mistakes are explained more in Cannot concretize ecp-proxy-apps #8133 (comment)

I'm inclined to add a note to #8133 and close this (since IMO there is substantial overlap).

[EmreAtes]

This resolved my spec issue. I'm having some other problems compiling it, but they are not related to this issue and probably resolvable. I think a note at 8133 for people encountering this problem is reasonable.

[junghans]

Duplicate of #8133