[FEA] Add option to build faiss and treelite shared libs, inherit common dependencies from raft

[trxcllnt]

Depends on rapidsai/raft#345, and CI will be blocked until raft is removed from libcumlprims install export set.

[trxcllnt]

rerun tests

[cjnolet]

rerun tests

[cjnolet]

Darn. It looks like even though we are using the cucollections patch that depends on thrust 1.15, CI in cuml is still pulling in thrust 1.12 from somewhere. I’m wondering if it’s something within cuML’s dependencies which is doing this (such as cumlprims_mg maybe?) since the RAFT side seems to be properly using thrust 1.15 (as evidenced in this CI log)

[cjnolet]

Looks like a signature change issue with ML::HDBSCAN::detail::Utils::cub_segmented_reduce

@trxcllnt and I finally figured out that there are conflicting versions of thrust being pulled in, which are causing the issues w/ the cub::DeviceSegmentedReduce signature.

[robertmaynard]

Darn. It looks like even though we are using the cucollections patch that depends on thrust 1.15, CI in cuml is still pulling in thrust 1.12 from somewhere. I’m wondering if it’s something within cuML’s dependencies which is doing this (such as cumlprims_mg maybe?) since the RAFT side seems to be properly using thrust 1.15 (as evidenced in this CI log)

I am reading the CI logs to be that Thrust 1.12 exists in the conda env, and therefore causing the mismatch issue for cuml.

-- Thrust: TargetInfo: Thrust::Thrust: (1.12.0.0)
-- Thrust: TargetInfo: Thrust::Thrust > ALIASED_TARGET: _Thrust_Thrust
-- Thrust: TargetInfo: Thrust::Thrust > INTERFACE_INCLUDE_DIRECTORIES: $PREFIX/include/rapids/thrust
-- Thrust: Assembling target rmm::Thrust. Options: FROM_OPTIONS
-- Thrust: Creating system cache options: (advanced=FALSE)

I believe this as INTERFACE_INCLUDE_DIRECTORIES is pointing to $PREFIX/include/rapids/thrust which isn't where a source build places Thrust, but where we install it after a build. To me this reads like an issue with the base container holding an older version of Thrust. When was the arm container last updated?

[robertmaynard]

rerun tests

[trxcllnt]

rerun tests

[cjnolet]

rerun tests

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (branch-22.02@5df7010). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff               @@
##             branch-22.02    #4256   +/-   ##
===============================================
  Coverage                ?   85.69%           
===============================================
  Files                   ?      236           
  Lines                   ?    19326           
  Branches                ?        0           
===============================================
  Hits                    ?    16562           
  Misses                  ?     2764           
  Partials                ?        0           

Flag	Coverage Δ
dask	46.52% <0.00%> (?)
non-dask	78.59% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5df7010...9f39243. Read the comment docs.

[cjnolet]

@gpucibot merge