generate_precompile script is requiring network access

[nico202]

Hi, when building the latest release tarball, I get

Generating REPL precompile statements... 29/29
Executing precompile statements... 1148/1148
ERROR: LoadError: AssertionError: n_succeeded > 1200

Any idea on why the total number of precompile statements is less than expected?

Thanks

[Sacha0]

You may be able to see more by toggling debug_output in contrib/generate_precompile.jl and rebuilding:

julia/contrib/generate_precompile.jl

Line 183 in f25d988

debug_output = devnull # or stdout

[KristofferC]

Yeah, it can be two things:

• We are naturally very close to that assertion threshold and should lower it.
• Something is going bad during the precompile generation and it isn't running what it should be running. Doing what @Sacha0 suggested should identify this.

[nico202]

Thanks, I rebuilt following @Sacha0 suggestion. It seems that the only thing going bad is the Pkg.add part (because the build happens in an environment with no internet connection, so cloning registry from "https://github.com/JuliaRegistries/General.git" fails). This leads to Pkg.develop to fail, and then Pkg.add.

I think I'll just lower the threshold for the guix package...
Thanks

[KristofferC]

Pkg.add part (because the build happens in an environment with no internet connection, so cloning registry from "https://github.com/JuliaRegistries/General.git" fails).

Oh, hm. That is a mistake from our side, that shouldn't run (exactly because it shouldn't require internet access to run that part).

[nico202]

Wait, I got the error wrong. It also complained about certificates, so I added nss-certs (mozilla CA certificates) to the build environment and now it did work (Executing precompile statements... 1323/1323)
Thanks! And congrats for the release

[vtjnash]

I thought we had issue before about avoiding network access in generate_precompile. This might be a regression?

[Sacha0]

IIRC generate_precompile builds a mock registry to avoid going to network, but the cert issue that nico202 mentioned breaks that mock setup, and downstream operations subsequently try to go to network. (We ran into the same issue :).) So I think all is well, it's just the cert issue.

[KristofferC]

Yep, I tried it myself without internet connection and it worked fine.

[ghost]

Encountered the same issue with Nix and it was addressed by adding cacert as a build input.

[nico202]

OT: @ninjin
Have you encountered errors like this:

/../lib/julia/libjulia-internal.so.1
Message:libLLVM-11.so: cannot open shared object file: No such file or directory

when running the built julia? I could fix this by wrapping the binary with LD_LIBRARY_PATH, but I guess it would be better to set the proper RPATH at build time

(I'm writing the package for guix)

[ghost]

@nico202 Not yet as I suspect you have gotten slightly further than me. This is probably not a good place for discussion, feel free to either drop me an e-mail or by all means join me in #nix over on the Julia Slack as I suspect there is plenty of knowledge/experience to be shared between Nix/Guix.