Precompile fails

[WaterQualityModels]

Trying to add Enzyme directly to new project after failure to add DiffEqFlux in different project. Adding Enzyme directly returns error:

(DiffEqFlux) pkg> add Enzyme
    Updating registry at `C:\Users\gregc\.julia\registries\General`
    Updating git-repo `https://github.com/JuliaRegistries/General.git`
   Resolving package versions...
    Updating `C:\Users\gregc\OneDrive\Documents\Graduate Courses\Julia\DiffEqFlux\Project.toml`
  [7da242da] + Enzyme v0.7.0
    Updating `C:\Users\gregc\OneDrive\Documents\Graduate Courses\Julia\DiffEqFlux\Manifest.toml`
  [79e6a3ab] + Adapt v3.3.1
  [fa961155] + CEnum v0.4.1
  [7da242da] + Enzyme v0.7.0
  [e2ba6199] + ExprTools v0.1.6
  [61eb1bfa] + GPUCompiler v0.12.9
  [692b3bcd] + JLLWrappers v1.3.0
  [929cbde3] + LLVM v4.6.0
  [d8793406] + ObjectFile v0.3.7
  [21216c6a] + Preferences v1.2.2
  [189a3867] + Reexport v1.2.2
  [53d494c1] + StructIO v0.3.0
  [a759f4b9] + TimerOutputs v0.5.13
  [7cc45869] + Enzyme_jll v0.0.19+0
  [dad2f222] + LLVMExtra_jll v0.0.11+0
  [0dad84c5] + ArgTools
  [56f22d72] + Artifacts
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [f43a241f] + Downloads
  [b77e0a4c] + InteractiveUtils
  [b27032c2] + LibCURL
  [76f85450] + LibGit2
  [8f399da3] + Libdl
  [37e2e46d] + LinearAlgebra
  [56ddb016] + Logging
  [d6f4376e] + Markdown
  [ca575930] + NetworkOptions
  [44cfe95a] + Pkg
  [de0858da] + Printf
  [3fa0cd96] + REPL
  [9a3f8284] + Random
  [ea8e919c] + SHA
  [9e88b42a] + Serialization
  [6462fe0b] + Sockets
  [fa267f1f] + TOML
  [a4e569a6] + Tar
  [8dfed614] + Test
  [cf7118a7] + UUIDs
  [4ec0a83e] + Unicode
  [deac9b47] + LibCURL_jll
  [29816b5a] + LibSSH2_jll
  [c8ffd9c3] + MbedTLS_jll
  [14a3606d] + MozillaCACerts_jll
  [83775a58] + Zlib_jll
  [8e850ede] + nghttp2_jll
  [3f19e933] + p7zip_jll
Precompiling project...
  Progress [========================================>]  1/1
  ✗ Enzyme
0 dependencies successfully precompiled in 3 seconds (16 already precompiled)
1 dependency errored

[vchuravy]

Was does using Enzyme yield?

[WaterQualityModels]

julia> using Enzyme
[ Info: Precompiling Enzyme [7da242da-08ed-463a-9acd-ee780be4f1d9]
ERROR: LoadError: LoadError: InitError: could not load library "C:\Users\gregc\.julia\artifacts\2f8dfc1505ab088ffd898f9f502372a14f47ed74\bin\libEnzyme-11.dll"
The specified module could not be found.
Stacktrace:
  [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
    @ Base.Libc.Libdl .\libdl.jl:114  
  [2] dlopen(s::String, flags::UInt32)
    @ Base.Libc.Libdl .\libdl.jl:114  
  [3] macro expansion
    @ ~\.julia\packages\JLLWrappers\bkwIo\src\products\library_generators.jl:54 [inlined]
  [4] __init__()
    @ Enzyme_jll ~\.julia\packages\Enzyme_jll\SgxzC\src\wrappers\x86_64-w64-mingw32-cxx11-julia_version+1.6.0.jl:8
  [5] _include_from_serialized(path::String, depmods::Vector{Any})
    @ Base .\loading.jl:674
  [6] _require_search_from_serialized(pkg::Base.PkgId, sourcepath::String)
    @ Base .\loading.jl:760
  [7] _require(pkg::Base.PkgId)
    @ Base .\loading.jl:998
  [8] require(uuidkey::Base.PkgId)
    @ Base .\loading.jl:914
  [9] require(into::Module, mod::Symbol)
    @ Base .\loading.jl:901
 [10] include(mod::Module, _path::String)
    @ Base .\Base.jl:386
 [11] include(x::String)
    @ Enzyme ~\.julia\packages\Enzyme\afnXq\src\Enzyme.jl:1
 [12] top-level scope
    @ ~\.julia\packages\Enzyme\afnXq\src\Enzyme.jl:85
 [13] include
    @ .\Base.jl:386 [inlined]
 [14] include_package_for_output(pkg::Base.PkgId, input::String, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt64}}, source::Nothing)
    @ Base .\loading.jl:1213
 [15] top-level scope
    @ none:1
 [16] eval
    @ .\boot.jl:360 [inlined]
 [17] eval(x::Expr)
    @ Base.MainInclude .\client.jl:446
 [18] top-level scope
    @ none:1
during initialization of module Enzyme_jll
in expression starting at C:\Users\gregc\.julia\packages\Enzyme\afnXq\src\api.jl:1
in expression starting at C:\Users\gregc\.julia\packages\Enzyme\afnXq\src\Enzyme.jl:1
ERROR: Failed to precompile Enzyme [7da242da-08ed-463a-9acd-ee780be4f1d9] to C:\Users\gregc\.julia\compiled\v1.6\Enzyme\jl_9A54.tmp.
Stacktrace:
  [1] error(s::String)
    @ Base .\error.jl:33
  [2] compilecache(pkg::Base.PkgId, path::String, internal_stderr::Base.TTY, internal_stdout::Base.TTY)    
    @ Base .\loading.jl:1360
  [3] compilecache(pkg::Base.PkgId, path::String)
    @ Base .\loading.jl:1306
  [4] _require(pkg::Base.PkgId)
    @ Base .\loading.jl:1021
  [5] require(uuidkey::Base.PkgId)
    @ Base .\loading.jl:914
  [6] require(into::Module, mod::Symbol)
    @ Base .\loading.jl:901
  [7] eval
    @ .\boot.jl:360 [inlined]
  [8] eval
    @ .\Base.jl:39 [inlined]
  [9] repleval(m::Module, code::Expr, #unused#::String)
    @ VSCodeServer ~\.vscode\extensions\julialang.language-julia-1.4.3\scripts\packages\VSCodeServer\src\repl.jl:157
 [10] (::VSCodeServer.var"#69#71"{Module, Expr, REPL.LineEditREPL, REPL.LineEdit.Prompt})()
    @ VSCodeServer ~\.vscode\extensions\julialang.language-julia-1.4.3\scripts\packages\VSCodeServer\src\repl.jl:123
 [11] with_logstate(f::Function, logstate::Any)
    @ Base.CoreLogging .\logging.jl:491
 [12] with_logger
    @ .\logging.jl:603 [inlined]
 [13] (::VSCodeServer.var"#68#70"{Module, Expr, REPL.LineEditREPL, REPL.LineEdit.Prompt})()
    @ VSCodeServer ~\.vscode\extensions\julialang.language-julia-1.4.3\scripts\packages\VSCodeServer\src\repl.jl:124
 [14] #invokelatest#2
    @ .\essentials.jl:708 [inlined]
 [15] invokelatest(::Any)
    @ Base .\essentials.jl:706
 [16] macro expansion
    @ ~\.vscode\extensions\julialang.language-julia-1.4.3\scripts\packages\VSCodeServer\src\eval.jl:34 [inlined]
 [17] (::VSCodeServer.var"#53#54")()
    @ VSCodeServer .\task.jl:406

[vchuravy]

Hm, very odd. We do have CI for Windows https://github.com/wsmoses/Enzyme.jl/runs/3768839737 and I haven't seen a failure like this before.

What version of Windows are you using? What is your versioninfo()

[WaterQualityModels]

Okay - thanks for the quick feedback. I'll wipe everything and try with new installs from the top.

Windows 10 Home, Version 2004, OS Build 19041.1237, Windows Feature Experience Pack 120.2212.3530.0

julia> versioninfo()
Julia Version 1.6.0
Commit f9720dc2eb (2021-03-24 12:55 UTC)
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i5-8400 CPU @ 2.80GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.1 (ORCJIT, skylake)
Environment:
  JULIA_CMDSTAN_HOME = C:\Users\gregc\.cmdstan
  JULIA_EDITOR = code
  JULIA_NUM_THREADS = 4

[vchuravy]

Maybe try Julia 1.6.3?

[WaterQualityModels]

I uninstalled VSCode and Julia and installed each new (upgrading to 1.6.3). Same error resulted.

Local solution: The artifacts folder referenced in the error was completely empty in ~/.julia, so I moved ~/.julia to a different tmp folder, reinstalled 1.6.3 again and then ran ]up in a new project to re-fetch everything from the registry fresh. Enzyme successfully precompiles now. DiffEqFlux successfully compiles in turn.

Not sure if this is of interest to you all to look at further, so I'll leave it open for you to close. Thanks again for the feedback.

[vchuravy]

Weird... cc: @staticfloat looks like something got into an inconsistent state.

[staticfloat]

Sounds like an artifact install got interrupted or somesuch. We don't have a very good way of detecting when this happens, perhaps eventually we'll have Pkg.verify() or something, which can ensure that everything on-disk is good.

[vchuravy]

👍 sounds like there is nothing to do from the Enzyme.jl side.