Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openmpi: migrate to Conan v2 #18980

Open
wants to merge 22 commits into
base: master
Choose a base branch
from
Open

Conversation

valgur
Copy link
Contributor

@valgur valgur commented Jul 31, 2023

In addition to typical migration changes also:

test_package builds and runs, but displaying of help messages currently fails due to OpenMPI not being able to locate its res folder.

@conan-center-bot

This comment has been minimized.

@conan-center-bot

This comment has been minimized.

@stale
Copy link

stale bot commented Oct 15, 2023

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@RubenRBS
Copy link
Member

@valgur any way we can help this one moving along? (Also, could you please set the zlib requirement to the [>=1.2.11 <2] version range? Thanks!)

@valgur
Copy link
Contributor Author

valgur commented Oct 23, 2023

@valgur any way we can help this one moving along? (Also, could you please set the zlib requirement to the [>=1.2.11 <2] version range? Thanks!)

A review of the rdma-core recipe, which is a dependency of this one, would be of great help. I hope the build for that one succeeds now as well. Thanks!

@conan-center-bot

This comment has been minimized.

@valgur valgur marked this pull request as ready for review December 13, 2023 22:59
@conan-center-bot

This comment has been minimized.

@conan-center-bot

This comment has been minimized.

@conan-center-bot

This comment has been minimized.

@conan-center-bot

This comment has been minimized.

This was referenced Jan 18, 2024
@conan-center-bot

This comment has been minimized.

@conan-center-bot

This comment has been minimized.

@conan-center-bot conan-center-bot added the Missing dependencies Build failed due missing dependencies in Conan Center label Apr 6, 2024
@conan-center-bot

This comment has been minimized.

@conan-center-bot conan-center-bot removed the Missing dependencies Build failed due missing dependencies in Conan Center label May 8, 2024
@conan-center-bot
Copy link
Collaborator

Conan v1 pipeline ❌

Failure in build 5 (0f8dfad39fdcda23ee504edfad4627ef30dd9b04):

  • openmpi/4.1.6:
    CI failed to create some packages (All logs)

    Logs for packageID 02293fdc6ea67597671953afe9e677ffd7b1d806:
    [settings]
    arch=x86_64
    build_type=Release
    compiler=gcc
    compiler.libcxx=libstdc++11
    compiler.version=5
    os=Linux
    [options]
    openmpi:shared=False
    
    [...]
    -- Library ibumad found /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libibumad.so
    -- Found: /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libibumad.so
    -- Library ibmad found /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libibmad.so
    -- Found: /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libibmad.so
    -- Library ibnetdisc found /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libibnetdisc.so
    -- Found: /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libibnetdisc.so
    -- Library efa found /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libefa.so
    -- Found: /home/conan/workspace/prod-v1/bsr/39710/bacea/.conan/data/rdma-core/51.0/_/_/package/b90c038763b1019159637c23a1068b556a1e855a/lib/libefa.so
    -- Dependency libnl already found
    -- Dependency libnl already found
    -- Configuring done
    -- Generating done
    CMake Error at /home/conan/workspace/prod-v1/bsr/cci-84ea4c8c/recipes/openmpi/all/test_package/CMakeLists.txt:6 (add_executable):
      Target "test_package" links to target "MPI::MPI_C" but the target was not
      found.  Perhaps a find_package() call is missing for an IMPORTED target, or
      an ALIAS target is missing?
    
    
    CMake Warning:
      Manually-specified variables were not used by the project:
    
        CMAKE_EXPORT_NO_PACKAGE_REGISTRY
        CMAKE_INSTALL_BINDIR
        CMAKE_INSTALL_DATAROOTDIR
        CMAKE_INSTALL_INCLUDEDIR
        CMAKE_INSTALL_LIBDIR
        CMAKE_INSTALL_LIBEXECDIR
        CMAKE_INSTALL_OLDINCLUDEDIR
        CMAKE_INSTALL_SBINDIR
    
    
    CMake Generate step failed.  Build files cannot be regenerated correctly.
    WARN: *** Conan 1 is legacy and on a deprecation path ***
    WARN: *** Please upgrade to Conan 2 ***
    openmpi/4.1.6 (test package): WARN: 
         ************************************************
         The 'cmake_find_package_multi' generator is deprecated.
         Please update your code and remove it.
         *************************************************
    
    openmpi/4.1.6 (test package): WARN: 
         ************************************************
         The 'cmake' generator is deprecated.
         Please update your code and remove it.
         *************************************************
    
    openmpi/4.1.6 (test package): WARN: **** The 'from conans import CMake' helper is deprecated. Please update your code and remove it. ****
    ERROR: openmpi/4.1.6 (test package): Error in build() method, line 11
    	cmake.configure()
    	ConanException: Error 1 while executing cd '/home/conan/workspace/prod-v1/bsr/cci-84ea4c8c/recipes/openmpi/all/test_v1_package/build/d2530af4bb2b0b56f24624c2e644b745696c692d' && cmake -G "Unix Makefiles" -DCMAKE_BUILD_TYPE="Release" -DCONAN_IN_LOCAL_CACHE="OFF" -DCONAN_COMPILER="gcc" -DCONAN_COMPILER_VERSION="5" -DCONAN_CXX_FLAGS="-m64" -DCONAN_SHARED_LINKER_FLAGS="-m64" -DCONAN_C_FLAGS="-m64" -DCONAN_LIBCXX="libstdc++11" -DCMAKE_INSTALL_PREFIX="/home/conan/workspace/prod-v1/bsr/cci-84ea4c8c/recipes/openmpi/all/test_v1_package/build/d2530af4bb2b0b56f24624c2e644b745696c692d/package" -DCMAKE_INSTALL_BINDIR="bin" -DCMAKE_INSTALL_SBINDIR="bin" -DCMAKE_INSTALL_LIBEXECDIR="bin" -DCMAKE_INSTALL_LIBDIR="lib" -DCMAKE_INSTALL_INCLUDEDIR="include" -DCMAKE_INSTALL_OLDINCLUDEDIR="include" -DCMAKE_INSTALL_DATAROOTDIR="share" -DCMAKE_PREFIX_PATH="/home/conan/workspace/prod-v1/bsr/cci-84ea4c8c/recipes/openmpi/all/test_v1_package/build/d2530af4bb2b0b56f24624c2e644b745696c692d" -DCMAKE_MODULE_PATH="/home/conan/workspace/prod-v1/bsr/cci-84ea4c8c/recipes/openmpi/all/test_v1_package/build/d2530af4bb2b0b56f24624c2e644b745696c692d" -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY="ON" -DCONAN_EXPORTED="1" -Wno-dev '/home/conan/workspace/prod-v1/bsr/cci-84ea4c8c/recipes/openmpi/all/test_v1_package'
    
  • openmpi/4.1.0:
    Didn't run or was cancelled before finishing


Note: To save resources, CI tries to finish as soon as an error is found. For this reason you might find that not all the references have been launched or not all the configurations for a given reference. Also, take into account that we cannot guarantee the order of execution as it depends on CI workload and workers availability.


Conan v2 pipeline ❌

Note: Conan v2 builds are now mandatory. Please read our discussion about it.

The v2 pipeline failed. Please, review the errors and note this is required for pull requests to be merged. In case this recipe is still not ported to Conan 2.x, please, ping @conan-io/barbarians on the PR and we will help you.

See details:

Failure in build 5 (0f8dfad39fdcda23ee504edfad4627ef30dd9b04):

  • openmpi/4.1.6:
    CI failed to create some packages (All logs)

    Logs for packageID 43ec0221ce34abe8d5957c0ae2a0c0574eaa2de3:
    [settings]
    arch=x86_64
    build_type=Release
    compiler=gcc
    compiler.cppstd=17
    compiler.libcxx=libstdc++11
    compiler.version=11
    os=Linux
    [options]
    */*:shared=True
    
    [...]
    
    +++ Configuring MCA framework common
    checking for no configure components in framework common... 
    checking for m4 configure components in framework common... cuda, ofi, sm, ucx, verbs, verbs_usnic
    
    --- MCA component common:cuda (m4 configuration macro)
    checking for MCA component common:cuda compile mode... dso
    checking if MCA component common:cuda can compile... no
    
    --- MCA component common:ofi (m4 configuration macro)
    checking for MCA component common:ofi compile mode... dso
    checking --with-ofi value... simple no (specified --without-ofi)
    checking --with-ofi-libdir value... simple ok (unspecified value)
    checking if MCA component common:ofi can compile... no
    
    --- MCA component common:sm (m4 configuration macro)
    checking for MCA component common:sm compile mode... dso
    checking if MCA component common:sm can compile... yes
    
    --- MCA component common:ucx (m4 configuration macro)
    checking for MCA component common:ucx compile mode... dso
    checking --with-ucx value... simple no (specified --without-ucx)
    checking --with-ucx-libdir value... simple ok (unspecified value)
    checking whether open_memstream is declared... yes
    checking if MCA component common:ucx can compile... no
    
    --- MCA component common:verbs (m4 configuration macro)
    checking for MCA component common:verbs compile mode... dso
    checking if want to add padding to the openib BTL control header... no
    checking for fcntl.h... (cached) yes
    checking sys/poll.h usability... yes
    checking sys/poll.h presence... yes
    checking for sys/poll.h... yes
    checking infiniband/verbs.h usability... yes
    checking infiniband/verbs.h presence... yes
    checking for infiniband/verbs.h... yes
    checking for library containing ibv_open_device... no
    checking if ConnectX XRC support is enabled... no
    checking if ConnectIB XRC support is enabled... no
    checking if dynamic SL is enabled... no
    configure: WARNING: Verbs support requested (via --with-verbs) but not found.
    configure: WARNING: If you are using libibverbs v1.0 (i.e., OFED v1.0 or v1.1), you *MUST* have both the libsysfs headers and libraries installed.  Later versions of libibverbs do not require libsysfs.
    configure: error: Aborting.
    
    openmpi/4.1.6: ERROR: 
    Package '43ec0221ce34abe8d5957c0ae2a0c0574eaa2de3' build failed
    openmpi/4.1.6: WARN: Build folder /home/conan/workspace/prod-v2/bsr/35536/ccecb/p/b/openm93a5b8474502e/b/build-release
    ERROR: openmpi/4.1.6: Error in build() method, line 156
    	autotools.configure()
    	ConanException: Error 1 while executing
    
  • openmpi/4.1.0:
    Didn't run or was cancelled before finishing


Note: To save resources, CI tries to finish as soon as an error is found. For this reason you might find that not all the references have been launched or not all the configurations for a given reference. Also, take into account that we cannot guarantee the order of execution as it depends on CI workload and workers availability.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants