Julia 1.7.0 breaks

[IvanYashchuk]

Hello, on a fresh Julia 1.7.0 install (using https://julialang-s3.julialang.org/bin/linux/x64/1.7/julia-1.7.0-linux-x86_64.tar.gz) ] add AMDGPU fails:

    Building AMDGPU → `/local/yashchuk/.julia/scratchspaces/44cfe95a-1eb2-52ea-b672-e2afdf69b78f/d59f1cf3f90ae6cf6626e8a21f337850cb3792f7/build.log`
Precompiling project...
  ✗ ROCmOpenCLRuntime_jll
  ✗ HIP_jll
  48 dependencies successfully precompiled in 15 seconds
  2 dependencies errored. To see a full report either run `import Pkg; Pkg.precompile()` or load the packages

julia> using ROCmOpenCLRuntime_jll
 │ Package ROCmOpenCLRuntime_jll not found, but a package named ROCmOpenCLRuntime_jll is available from a registry.
 │ Install package?
 │   (@v1.7) pkg> add ROCmOpenCLRuntime_jll
 └ (y/n) [y]: y
   Resolving package versions...
    Updating `/local/yashchuk/.julia/environments/v1.7/Project.toml`
  [10ae2a08] + ROCmOpenCLRuntime_jll v4.0.0+1
  No Changes to `/local/yashchuk/.julia/environments/v1.7/Manifest.toml`
[ Info: Precompiling ROCmOpenCLRuntime_jll [10ae2a08-2eea-53f8-8c20-eec175020e9f]
ERROR: LoadError: InitError: could not load library "/local/yashchuk/.julia/artifacts/82a9b43b2e268b88036cd38d94b7521ad2ba453e/lib/libamd_comgr.so"
libLLVM-11jl.so: cannot open shared object file: No such file or directory
Stacktrace:
  [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
    @ Base.Libc.Libdl ./libdl.jl:117
  [2] dlopen(s::String, flags::UInt32)
    @ Base.Libc.Libdl ./libdl.jl:117
  [3] macro expansion
    @ /local/yashchuk/.julia/packages/JLLWrappers/bkwIo/src/products/library_generators.jl:54 [inlined]
  [4] __init__()
    @ ROCmCompilerSupport_jll /local/yashchuk/.julia/packages/ROCmCompilerSupport_jll/1VSyi/src/wrappers/x86_64-linux-gnu-cxx11.jl:10
  [5] _include_from_serialized(path::String, depmods::Vector{Any})
    @ Base ./loading.jl:768
  [6] _require_search_from_serialized(pkg::Base.PkgId, sourcepath::String)
    @ Base ./loading.jl:854
  [7] _require(pkg::Base.PkgId)
    @ Base ./loading.jl:1097
  [8] require(uuidkey::Base.PkgId)
    @ Base ./loading.jl:1013
  [9] require(into::Module, mod::Symbol)
    @ Base ./loading.jl:997
 [10] include(mod::Module, _path::String)
    @ Base ./Base.jl:418
 [11] top-level scope
    @ /local/yashchuk/.julia/packages/JLLWrappers/bkwIo/src/toplevel_generators.jl:170
 [12] include
    @ ./Base.jl:418 [inlined]
 [13] include_package_for_output(pkg::Base.PkgId, input::String, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt64}}, source::Nothing)
    @ Base ./loading.jl:1318
 [14] top-level scope
    @ none:1
 [15] eval
    @ ./boot.jl:373 [inlined]
 [16] eval(x::Expr)
    @ Base.MainInclude ./client.jl:453
 [17] top-level scope
    @ none:1
during initialization of module ROCmCompilerSupport_jll
in expression starting at /local/yashchuk/.julia/packages/ROCmOpenCLRuntime_jll/ufDco/src/wrappers/x86_64-linux-gnu-cxx11.jl:6
in expression starting at /local/yashchuk/.julia/packages/ROCmOpenCLRuntime_jll/ufDco/src/ROCmOpenCLRuntime_jll.jl:2
ERROR: Failed to precompile ROCmOpenCLRuntime_jll [10ae2a08-2eea-53f8-8c20-eec175020e9f] to /local/yashchuk/.julia/compiled/v1.7/ROCmOpenCLRuntime_jll/jl_cnef7i.
Stacktrace:
 [1] error(s::String)
   @ Base ./error.jl:33
 [2] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IO, internal_stdout::IO, ignore_loaded_modules::Bool)
   @ Base ./loading.jl:1466
 [3] compilecache(pkg::Base.PkgId, path::String)
   @ Base ./loading.jl:1410
 [4] _require(pkg::Base.PkgId)
   @ Base ./loading.jl:1120
 [5] require(uuidkey::Base.PkgId)
   @ Base ./loading.jl:1013
 [6] require(into::Module, mod::Symbol)
   @ Base ./loading.jl:997

And the same failure with using HIP_jll.

Everything is working with Julia 1.6.4

[jpsamaroo]

Julia 1.7 is not yet supported, due to 1.7 using a newer LLVM version. I have a working branch locally, but I still need to get all the new artifacts built and published (currently blocked on JuliaPackaging/Yggdrasil#3776).

[IvanYashchuk]

Thanks for the update, @jpsamaroo!

[jpsamaroo]

@IvanYashchuk can you please try with #187?

[IvanYashchuk]

] add AMDGPU now works, but using AMDGPU gives:

julia> using AMDGPU
┌ Warning: ld.lld was not found, compilation functionality will be unavailable.
│ Please run Pkg.build("AMDGPU") and reload AMDGPU.
│ Reason: ld.lld executable not found
└ @ AMDGPU /local/yashchuk/.julia/packages/AMDGPU/ZIg6T/src/AMDGPU.jl:207
┌ Warning: ROCm-Device-Libs were not found, device intrinsics will be unavailable.
│ Please run Pkg.build("AMDGPU") and reload AMDGPU.
│ Reason: unknown
└ @ AMDGPU /local/yashchuk/.julia/packages/AMDGPU/ZIg6T/src/AMDGPU.jl:226

The above behavior is with export JULIA_AMDGPU_DISABLE_ARTIFACTS=1 and ROCm 4.5. Using JULIA_AMDGPU_DISABLE_ARTIFACTS=0 results in the same warnings.

Running ]test AMDGPU:

     Testing Running tests...
┌ Warning: ld.lld was not found, compilation functionality will be unavailable.
│ Please run Pkg.build("AMDGPU") and reload AMDGPU.
│ Reason: ld.lld executable not found
└ @ AMDGPU /local/yashchuk/.julia/packages/AMDGPU/ZIg6T/src/AMDGPU.jl:207
┌ Warning: ROCm-Device-Libs were not found, device intrinsics will be unavailable.
│ Please run Pkg.build("AMDGPU") and reload AMDGPU.
│ Reason: unknown
└ @ AMDGPU /local/yashchuk/.julia/packages/AMDGPU/ZIg6T/src/AMDGPU.jl:226
[ Info: Testing using device GPU: Vega 20 (gfx906)
┌ Warning: AMDGPU.jl has not been configured; skipping on-device tests.
└ @ Main /local/yashchuk/.julia/packages/AMDGPU/ZIg6T/test/runtests.jl:85
Test Summary: | Broken  Total
AMDGPU        |      1      1
     Testing AMDGPU tests passed

[jpsamaroo]

Ok, that's generally expected.

For the ld.lld error, we're waiting on JuliaPackaging/Yggdrasil#4279 so we can ship our own ld.lld; in the meantime, you could install it locally (system-wide) and AMDGPU should probably detect it.

For the device libs error, you can also merge in #185, which improves device lib detection when not using artifacts.

[IvanYashchuk]

Thank you for the suggestions I will try them and report any further problems I encounter separately.

The package now installs without errors with Julia 1.7 so we can close this issue.