WIP: julia: update to 1.7.1. #35270

non-Jedi · 2022-01-28T05:31:16Z

Still need to finish building/testing locally and separating out into logical commits, but I thought I should put this here to make sure there's no duplicated effort since I'm not sure when I'll finish this up, and libblastrampoline was annoying to get to build correctly.

[ci skip] for building llvm.

Testing the changes

I tested the changes in this PR: YES|briefly|NO

kwshi · 2022-01-30T08:23:22Z

thanks for doing the hard work on this, as a void julia user, i appreciate it! ❤️

Piraty · 2022-01-30T13:45:38Z

please take care of #35270

Piraty · 2022-01-30T17:33:25Z

libblastrampoline's tests require julia which would result in cyclic dependency, maybe put a comment ?

Piraty · 2022-01-30T17:50:44Z

also, JuliaLinearAlgebra/libblastrampoline@39d859e is interesting (though appears not entirely correct for the static lib)

non-Jedi · 2022-01-30T18:41:53Z

please take care of #35270

Looks like you linked the wrong issue/PR.

non-Jedi · 2022-02-04T02:36:29Z

Where I'm stuck at with this right now is that julia's build system seems to want to build all dependencies regardless of which USE_SYSTEM_* flags are set. This of course means that it tries to build libblastrampoline as a vendored dep which isn't successful without the flags I have set in the template for that package, so I haven't gotten julia 1.7 to successfully build at all yet. I'm going to ask around; feel like I must be doing something wrong.

This needs to be separated out into two commits: one for the new libblastrampoline package.

non-Jedi · 2022-02-05T04:55:23Z

This appears to be some sort of issue with an interaction between the xbps-src system and julia's build system. Invoking make manually with the value of make_build_args causes only the desired libraries to be built, but when run from the build phase, it attempts to build all vedored dependencies entirely ignoring the USE_SYSTEM_* flags. Any ideas on this would be appreciated as I'm getting close to the end of my ability to debug this.

Any thoughts @ahesford since you have some level of familiarity with this template?

kwshi · 2022-02-05T07:03:35Z

I've attempted to take a look at this and tried to build it by hand (manually running make from the cloned source with correct arguments set). Curiously, I seem to be running into a separate issue wherein the make build script is attempting but failing to detect/load/symlink the libblastrampoline.so library, even after I built and installed the libblastrampoline package included in this PR.

I'm not sure why--my best attempt at reading the Makefile to figure out what's happening seems to point to it using libwhich to locate libraries; when I try to manually run libwhich -p libblastrampoline.so, I get

failed to open library: /usr/lib/libblastrampoline.so: undefined symbol: f2c_sdot_64_

which suggests something additionally may be broken with the current state of the libblastrampoline package. I doubt that's the same issue @non-Jedi you're facing with the USE_* variables getting ignored, but it seems to be yet another barrier in getting things to build correctly. Have you encountered this?

ahesford

Unfortunately, I haven't had any time to look at the build problems here and am not sure when I'll have some spare time to dig in. The few points I make below are based just on reading the template and not actually trying to build it.

ahesford · 2022-02-22T19:03:26Z

srcpkgs/julia/template

 make_install_args="$make_build_args"
 make_check_args="$make_build_args"
 make_check_target=testall
 conf_files="/etc/julia/startup.jl"
-hostmakedepends="pkg-config perl cmake python gcc-fortran patchelf which tar xz"
+hostmakedepends="pkg-config perl cmake python3 gcc-fortran patchelf which tar xz libwhich"


I wonder if libwhich here is complicating the search for libraries in a way that triggers vendored builds of libraries you've installed in makedepends.

ahesford · 2022-02-22T19:04:08Z

srcpkgs/julia/template

 makedepends="p7zip pcre2-devel mpfr-devel libgit2-devel libcurl-devel nghttp2-devel
 libssh2-devel mbedtls-devel libatomic-devel zlib-devel libunwind-devel
- libutf8proc-devel"
+ libutf8proc-devel libblastrampoline-devel openblas-devel"


You mentioned "vendored builds" below; what is the purpose for pulling openblas-devel here if a vendored build will be done?

ahesford · 2022-02-22T19:05:06Z

srcpkgs/julia/template

 nocross="build system is a mess"
+noverifyrdeps="Julia doesn't need to depend on system llvm/openblas with vendored builds in /usr/lib/julia/"


This is a pretty big hammer and can often lead to dependency problems. Can this be replaced with a skiprdeps list that explicitly exempts only those files that trigger erroneous dependency resolution?

Rabioli · 2022-02-25T05:52:34Z

I was messing with julia on musl, I don't know what you guys are using but, at least for me, the void package appears to work but doesn't (it segfaults when trying to add new julia packages).

So I tried their official musl binary that doesn't even work either until I settled for compiling it myself which has given me the best result so far I haven't run into any issue with dependent on julia.

The relevancy into this issue is one, there is already a 1.7.2 release and soon to come out 1.8.0 and second could it be possible to export or reverse engineer the flags used by make "by default" so we can use them for the template?

I also attempted to make a template, but it just didn't work at all, like just changing the version and the checksums broke it all.

Piraty · 2022-04-21T21:04:09Z

oh, i meant to link #34387

Piraty · 2022-07-06T22:31:14Z

ping

github-actions · 2022-10-05T02:13:43Z

Pull Requests become stale 90 days after last activity and are closed 14 days after that. If this pull request is still relevant bump it or assign it.

* FTBFS: void-linux#34387 * unmaintained: void-linux#35270 * blocks libgit2 update

Piraty · 2022-10-13T13:23:23Z

closing, see #39919

* FTBFS: #34387 * unmaintained: #35270 * blocks libgit2 update

* FTBFS: void-linux#34387 * unmaintained: void-linux#35270 * blocks libgit2 update

non-Jedi force-pushed the julia-1.7.1 branch from 061d8aa to 2860842 Compare January 28, 2022 05:33

Piraty mentioned this pull request Jan 30, 2022

libgit2: update to 1.5.0. #35310

Merged

10 tasks

non-Jedi force-pushed the julia-1.7.1 branch 2 times, most recently from cb575ac to 72a45c9 Compare February 5, 2022 04:51

WIP: julia: update to 1.7.1.

7219cbd

This needs to be separated out into two commits: one for the new libblastrampoline package.

non-Jedi force-pushed the julia-1.7.1 branch from 72a45c9 to 7219cbd Compare February 5, 2022 04:53

ahesford reviewed Feb 22, 2022

View reviewed changes

github-actions bot added the Stale label Oct 5, 2022

Piraty added a commit to Piraty/void-packages that referenced this pull request Oct 12, 2022

julia: remove

277724c

* FTBFS: void-linux#34387 * unmaintained: void-linux#35270 * blocks libgit2 update

Piraty added a commit to Piraty/void-packages that referenced this pull request Oct 12, 2022

julia: remove

eb77528

* FTBFS: void-linux#34387 * unmaintained: void-linux#35270 * blocks libgit2 update

Piraty mentioned this pull request Oct 12, 2022

julia: remove #39919

Merged

Piraty closed this Oct 13, 2022

Piraty added a commit that referenced this pull request Oct 13, 2022

julia: remove

302b28c

* FTBFS: #34387 * unmaintained: #35270 * blocks libgit2 update

pfpulux pushed a commit to pfpulux/void-packages that referenced this pull request Oct 25, 2022

julia: remove

d9558e8

* FTBFS: void-linux#34387 * unmaintained: void-linux#35270 * blocks libgit2 update

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP: julia: update to 1.7.1. #35270

WIP: julia: update to 1.7.1. #35270

non-Jedi commented Jan 28, 2022

kwshi commented Jan 30, 2022

Piraty commented Jan 30, 2022

Piraty commented Jan 30, 2022

Piraty commented Jan 30, 2022

non-Jedi commented Jan 30, 2022

non-Jedi commented Feb 4, 2022

non-Jedi commented Feb 5, 2022 •

edited

Loading

kwshi commented Feb 5, 2022

ahesford left a comment

ahesford Feb 22, 2022

ahesford Feb 22, 2022

ahesford Feb 22, 2022

Rabioli commented Feb 25, 2022

Piraty commented Apr 21, 2022

Piraty commented Jul 6, 2022

github-actions bot commented Oct 5, 2022

Piraty commented Oct 13, 2022

		nocross="build system is a mess"
		noverifyrdeps="Julia doesn't need to depend on system llvm/openblas with vendored builds in /usr/lib/julia/"

WIP: julia: update to 1.7.1. #35270

WIP: julia: update to 1.7.1. #35270

Conversation

non-Jedi commented Jan 28, 2022

Testing the changes

kwshi commented Jan 30, 2022

Piraty commented Jan 30, 2022

Piraty commented Jan 30, 2022

Piraty commented Jan 30, 2022

non-Jedi commented Jan 30, 2022

non-Jedi commented Feb 4, 2022

non-Jedi commented Feb 5, 2022 • edited Loading

kwshi commented Feb 5, 2022

ahesford left a comment

Choose a reason for hiding this comment

ahesford Feb 22, 2022

Choose a reason for hiding this comment

ahesford Feb 22, 2022

Choose a reason for hiding this comment

ahesford Feb 22, 2022

Choose a reason for hiding this comment

Rabioli commented Feb 25, 2022

Piraty commented Apr 21, 2022

Piraty commented Jul 6, 2022

github-actions bot commented Oct 5, 2022

Piraty commented Oct 13, 2022

non-Jedi commented Feb 5, 2022 •

edited

Loading