llvm-project-rustc: Rust-Lang Enhanced/Specifc LLVM 14.0.0 by Grommish · Pull Request #18322 · openwrt/packages

Grommish · 2022-04-18T06:42:23Z

This is the rust enhanced/specific LLVM 14.0.0 toolchain, used
in building/linking rust-lang projects.

We cannot use the existing OpenWrt eBPF LLVM toolchain for this.
The eBPF LLVM toolchain only builds for eBPF, but we need the
rust enhanced LLVM and support for AArch64, ARM, Mips, PowerPC,
and X86.

This LLVM is stored/preserved in staging_dir/host/llvm-rust and
carries over a clean, requiring only a build once situation
(unless the LLVM changes, or staging_dir gets removed).

Used/Required for #13916

Signed-off-by: Donald Hoskins grommish@gmail.com

Rust is a multi-paradigm, general-purpose programming language designed for performance and safety, especially safe concurrency. It is syntactically similar to C++, but can guarantee memory safety by using a borrow checker to validate references. This introduces support for an external rust-specific LLVM toolchain. This update introduces the following target tuples: mips64-openwrt-linux-musl (upstreamed) mips-openwrt-linux-musl mipsel-openwrt-linux-musl aarch64-openwrt-linux-musl arm-openwrt-linux-muslgnueabi arm-openwrt-linux-muslgnueabihf armv5-openwrt-linux-muslgnueabi armv7-openwrt-linux-muslgnueabi armv7-openwrt-linux-muslgnueabihf Initial testing and support for: powerpc64-openwrt-linux-musl x86_64-openwrt-linux-musl The HOST and TARGET Tuples are stored in staging_dir/host and will survive make clean and various rebuilds for persistence. Requires commit openwrt#18322 Signed-off-by: Donald Hoskins <grommish@gmail.com>

Grommish · 2022-04-18T06:54:01Z

Before someone asks, no, we cannot use the OpenWrt eBPF LLVM toolchain for this. Not only is the eBPF LLVM toolchain only building for eBPF, but we need the rust enhanced LLVM (and mine supports AArch64, ARM, Mips, PowerPC, and X86)

champtar · 2022-04-18T11:58:23Z

Before someone asks, no, we cannot use the OpenWrt eBPF LLVM toolchain for this. Not only is the eBPF LLVM toolchain only building for eBPF, but we need the rust enhanced LLVM (and mine supports AArch64, ARM, Mips, PowerPC, and X86)

This info should be in the commit message then

Grommish · 2022-04-19T11:09:18Z

rust-lang/llvm-project pushes changes to their dated branches without updating the dated branches. This is, as you've found, cause issues. I will work on another way to do this.

Grommish · 2022-04-19T20:16:28Z

Due to the way rust-lang llvm-project is branched, with no release
artifacts, and additional issue with the fact GitHub cannot/will
not guarentee sha256sums over time for the same commit head, I am
moving to a cloned repo. This is a significant space investment
on the clone, but ultimately a smaller space footprint in the
dl/ section as I can use .xz rather than .zip/.tar.gz

PKG_MIRROR_HASH is intentionally left as "skip" because no tarball
is available from the Openwrt buildbots. If this becomes available
from the build-bot, that will probably be set by it.

Grommish · 2022-04-20T00:40:57Z

ln -s llvm-rust-14.0.0.Linux-x86_64 /home/ubuntu/21/staging_dir/host/llvm-rust STRIP_KMOD= PATCHELF= STRIP=strip /home/ubuntu/21/scripts/rstrip.sh /home/ubuntu/21/staging_dir/host/llvm-rust echo "14.0.0" > /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version bash: /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version: No such file or directory

Do you have a staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/ directory?

openwrtfirmwarecostum · 2022-04-20T00:42:59Z

ln -s llvm-rust-14.0.0.Linux-x86_64 /home/ubuntu/21/staging_dir/host/llvm-rust STRIP_KMOD= PATCHELF= STRIP=strip /home/ubuntu/21/scripts/rstrip.sh /home/ubuntu/21/staging_dir/host/llvm-rust echo "14.0.0" > /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version bash: /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version: No such file or directory

Do you have a staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/ directory?

there isn't any

Grommish · 2022-04-20T00:55:09Z

ln -s llvm-rust-14.0.0.Linux-x86_64 /home/ubuntu/21/staging_dir/host/llvm-rust STRIP_KMOD= PATCHELF= STRIP=strip /home/ubuntu/21/scripts/rstrip.sh /home/ubuntu/21/staging_dir/host/llvm-rust echo "14.0.0" > /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version bash: /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version: No such file or directory

Do you have a staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/ directory?

there isn't any

That is like the second to last step in the package.

make package/feeds/packages/llvm-project-rustc/{clean,compile}

openwrtfirmwarecostum · 2022-04-20T00:57:27Z

ln -s llvm-rust-14.0.0.Linux-x86_64 /home/ubuntu/21/staging_dir/host/llvm-rust STRIP_KMOD= PATCHELF= STRIP=strip /home/ubuntu/21/scripts/rstrip.sh /home/ubuntu/21/staging_dir/host/llvm-rust echo "14.0.0" > /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version bash: /home/ubuntu/21/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version: No such file or directory

Do you have a staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/ directory?

there isn't any

That is like the second to last step in the package.

make package/feeds/packages/llvm-project-rustc/{clean,compile}

for now I leave rust. I've tried twice

Grommish · 2022-04-20T00:57:30Z

@Grommish

https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink

You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

openwrtfirmwarecostum · 2022-04-20T01:03:14Z

@Grommish
https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink

You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

strange I didn't commit and didn't change the makefile

Grommish · 2022-04-20T01:04:44Z

@Grommish
https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink
You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

strange I didn't commit and didn't change the makefile

Did you pull down the change the PR that removes the pre-packed archive in exchange for the cloned repo that I pushed earlier today?

Grommish · 2022-04-20T01:07:35Z

@Grommish
https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink
You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

strange I didn't commit and didn't change the makefile

Did you pull down the change the PR that removes the pre-packed archive in exchange for the cloned repo that I pushed earlier today?

i made it with openwrt sdk and put llvm-project-rustc in the package folder

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

openwrtfirmwarecostum · 2022-04-20T01:14:04Z

@Grommish
https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink
You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

strange I didn't commit and didn't change the makefile

Did you pull down the change the PR that removes the pre-packed archive in exchange for the cloned repo that I pushed earlier today?

i made it with openwrt sdk and put llvm-project-rustc in the package folder

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

it should work because llvm-project-rustc is in packages/devel

Grommish · 2022-04-20T01:16:28Z

@Grommish
https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink
You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

strange I didn't commit and didn't change the makefile

Did you pull down the change the PR that removes the pre-packed archive in exchange for the cloned repo that I pushed earlier today?

i made it with openwrt sdk and put llvm-project-rustc in the package folder

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

it should work because llvm-project-rustc is in packages/devel

Can you try the make V=sc package/feeds/packages/llvm-project-rust/{clean,compile} and tell me what it says/if/where it errors for you?

And can you verify you have 100868392 Apr 19 09:07 dl/llvm-project-rustc-14.0.0-2022-03-22.tar.xz?

openwrtfirmwarecostum · 2022-04-20T03:23:19Z

@Grommish
https://youtube.com/shorts/MuYO6jagkR4?feature=share

Right, that is in build_dir/hostpkg, not staging_dir/host/. I expect what that video to show to be where you found it, but staging_dir/host/ should have a llvm-rust-14.0.0.Linux-x86_64/ and a llvm-rust/ symlink
You error'd on the last step (https://github.com/openwrt/packages/pull/18322/files#diff-b4e31a91efc8abfddf3de0eabf84c13e8ea2b8fb3ab64cb216df28c4b5a8401fR88) and you're saying it isn't there. What steps did you do? I've built out LLVM twice today, the rust HOST toolchain 3 times, and several target toolchains (working on testing ARM11MPCORE and ARMv6 arm1176jzf-s)

strange I didn't commit and didn't change the makefile

Did you pull down the change the PR that removes the pre-packed archive in exchange for the cloned repo that I pushed earlier today?

i made it with openwrt sdk and put llvm-project-rustc in the package folder

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

it should work because llvm-project-rustc is in packages/devel

Can you try the make V=sc package/feeds/packages/llvm-project-rust/{clean,compile} and tell me what it says/if/where it errors for you?

And can you verify you have 100868392 Apr 19 09:07 dl/llvm-project-rustc-14.0.0-2022-03-22.tar.xz?

I will redo it. i will tell you

Grommish · 2022-04-20T07:12:27Z

@Grommish

https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_150541.jpg

I'm building out LLVM right now from a rm -rf bin/ build_dir/ dl/ staging_dir/ tmp/ .config

I'll have to let you know if I hit an error, but I suspect if I don't it has to do with building from the SDK rather than source. I'll check back when it's done.

openwrtfirmwarecostum · 2022-04-20T07:15:01Z

@Grommish
https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_150541.jpg

I'm building out LLVM right now from a rm -rf bin/ build_dir/ dl/ staging_dir/ tmp/ .config

I'll have to let you know if I hit an error, but I suspect if I don't it has to do with building from the SDK rather than source. I'll check back when it's done.

https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_151218.jpg

Grommish · 2022-04-20T07:16:43Z

@Grommish
https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_150541.jpg

I'm building out LLVM right now from a rm -rf bin/ build_dir/ dl/ staging_dir/ tmp/ .config

I'll have to let you know if I hit an error, but I suspect if I don't it has to do with building from the SDK rather than source. I'll check back when it's done.

https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_151218.jpg

Can you scroll up and show the error as to why it failed?

openwrtfirmwarecostum · 2022-04-20T07:18:43Z

@Grommish
https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_150541.jpg

I'm building out LLVM right now from a rm -rf bin/ build_dir/ dl/ staging_dir/ tmp/ .config

I'll have to let you know if I hit an error, but I suspect if I don't it has to do with building from the SDK rather than source. I'll check back when it's done.

https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_151218.jpg

Can you scroll up and show the error as to why it failed?

-- Up-to-date: /home/ubuntu/openwrt/staging_dir/hostpkg/lib/cmake/llvm/./CheckCompilerVersion.cmake
-- Up-to-date: /home/ubuntu/openwrt/staging_dir/hostpkg/lib/cmake/llvm/./GetErrcMessages.cmake
make[3]: Leaving directory '/home/ubuntu/openwrt/build_dir/hostpkg/llvm-project-rustc-14.0.0-2022-03-22'ln -s llvm-rust-14.0.0.Linux-x86_64 /home/ubuntu/openwrt/staging_dir/host/llvm-rust
STRIP_KMOD= PATCHELF= STRIP=strip /home/ubuntu/openwrt/scripts/rstrip.sh /home/ubuntu/openwrt/staging_dir/host/llvm-rust
echo "14.0.0" > /home/ubuntu/openwrt/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version
bash: /home/ubuntu/openwrt/staging_dir/host/llvm-rust-14.0.0.Linux-x86_64/.llvm-version: No such file or directory
Makefile:95: recipe for target '/home/ubuntu/openwrt/staging_dir/hostpkg/stamp/.llvm-project-rustc_installed' failed
make[2]: *** [/home/ubuntu/openwrt/staging_dir/hostpkg/stamp/.llvm-project-rustc_installed] Error 1
make[2]: Leaving directory '/home/ubuntu/openwrt/feeds/packages/devel/llvm-project-rustc'
time: package/feeds/packages/llvm-project-rustc/compile#26.37#8.15#38.60
ERROR: package/feeds/packages/llvm-project-rustc failed to build.
package/Makefile:114: recipe for target 'package/feeds/packages/llvm-project-rustc/compile' failed
make[1]: *** [package/feeds/packages/llvm-project-rustc/compile] Error 1
make[1]: Leaving directory '/home/ubuntu/openwrt'
/home/ubuntu/openwrt/include/toplevel.mk:221: recipe for target 'package/rust/compile' failed
make: *** [package/rust/compile] Error 2

openwrtfirmwarecostum · 2022-04-20T07:34:35Z

@Grommish

there is no llvm-rust-14.0.0.Linux-x86_64 folder in llvm-project-rustc-14.0.0-2022-03-22 folder

openwrtfirmwarecostum · 2022-04-20T07:38:51Z

https://github.com/openwrtfirmwarecostum/su/blob/main/Screenshot_2022-04-20_153645.jpg

Grommish · 2022-04-20T07:47:04Z

I just finished building out from what essentially was a fresh repo without issue. Whatever is happening, it has to do with your build system setup.

openwrtfirmwarecostum · 2022-04-20T07:48:54Z

I just finished building out from what essentially was a fresh repo without issue. Whatever is happening, it has to do with your build system setup.

did you try sdk 21.02.2?

Grommish · 2022-04-20T07:50:28Z

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

No, as I told you prior, I only build from source on master branch (and suggested you do the same). I don't use/never have used SDK or ImageBuilder, and have no idea what issues (if any) it would cause.

Edit: In theory, there should be no reason you couldn't build out 21.x from source and not have this work, but again, I only build from the master branch (currently at HEAD 7a73221332 - (upstream/master, upstream/HEAD, master) build: use numeric-owner in ipkg-build (11 hours ago) <Paul Spooren>)

openwrtfirmwarecostum · 2022-04-20T07:57:50Z

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

No, as I told you prior, I only build from source on master branch (and suggested you do the same). I don't use/never have used SDK or ImageBuilder, and have no idea what issues (if any) it would cause.

Edit: In theory, there should be no reason you couldn't build out 21.x from source and not have this work, but again, I only build from the master branch (currently at HEAD 7a73221332 - (upstream/master, upstream/HEAD, master) build: use numeric-owner in ipkg-build (11 hours ago) <Paul Spooren>)

naturally you don't get an error you don't try it. for the master branch I don't use it for my daily use

Grommish · 2022-04-20T07:59:45Z

You need to build from source. I've never used the SDK and/or Imagebuilder, so I have no idea if it works or not (and suspect not however).

No, as I told you prior, I only build from source on master branch (and suggested you do the same). I don't use/never have used SDK or ImageBuilder, and have no idea what issues (if any) it would cause.
Edit: In theory, there should be no reason you couldn't build out 21.x from source and not have this work, but again, I only build from the master branch (currently at HEAD 7a73221332 - (upstream/master, upstream/HEAD, master) build: use numeric-owner in ipkg-build (11 hours ago) <Paul Spooren>)

naturally you don't get an error you don't try it. for the master branch I don't use it for my daily use

Understandable, but this package will never be backported to 21.xx or 22.xx. Those branches for Openwrt and Packages are locked except for security updates (or will be in the case of 22.xx by the time this is anywhere near ready).. Rust-lang will never be officially supported in those version, nor LLVM. I cannot burn time on something that will never be accepted into the repo. You are welcome to try and make it work, if you'd like, but I cannot at this time

openwrtfirmwarecostum · 2022-04-20T08:04:57Z

although this is not accepted in openwrt but we can manage rust so that it can be installed in openwrt. over time openwrt users need this. I really appreciate your work

openwrtfirmwarecostum · 2022-04-20T09:32:43Z

@Grommish

i understand now llvm is on master and openwrt 22.03.x. so now i will wait for 22.03.x stable release. thanks

wtf moments.... hehe

Grommish · 2022-04-20T09:57:32Z

The LLVM package that you are referring to is for the eBPF toolchain and will not work with rust.

…

On Wed, Apr 20, 2022, 5:32 AM openwrtfirmwarecostum < ***@***.***> wrote: @Grommish <https://github.com/Grommish> i understand now llvm is on master and openwrt 22.03.x. so now i will wait for 22.03.x stable release. thanks wtf moments.... hehe — Reply to this email directly, view it on GitHub <#18322 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABBY6JQLJI4CY3FTXZZX5TDVF7FMNANCNFSM5TVDODWA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

openwrtfirmwarecostum · 2022-04-20T10:03:20Z

The LLVM package that you are referring to is for the eBPF toolchain and will not work with rust.
…
On Wed, Apr 20, 2022, 5:32 AM openwrtfirmwarecostum < @.> wrote: @Grommish https://github.com/Grommish i understand now llvm is on master and openwrt 22.03.x. so now i will wait for 22.03.x stable release. thanks wtf moments.... hehe — Reply to this email directly, view it on GitHub <#18322 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABBY6JQLJI4CY3FTXZZX5TDVF7FMNANCNFSM5TVDODWA . You are receiving this because you were mentioned.Message ID: @.>

I mean the error is because openwrt 21.02 doesn't support llvm-bpf and I see the makefile in your rust is the same as the makefile in llvm-bpf

jefferyto · 2022-04-22T10:06:38Z

PKG_MIRROR_HASH is intentionally left as "skip" because no tarball
is available from the Openwrt buildbots. If this becomes available
from the build-bot, that will probably be set by it.

You can use the hash from the tarball created locally; it should be identical to the tarball created by buildbots.

No, as I told you prior, I only build from source on master branch (and suggested you do the same). I don't use/never have used SDK or ImageBuilder, and have no idea what issues (if any) it would cause.

AFAIK buildbots use the SDKs to build packages. There are also snapshot SDKs built from master, I believe once a day.

Grommish · 2022-04-22T16:38:33Z

PKG_MIRROR_HASH is intentionally left as "skip" because no tarball
is available from the Openwrt buildbots. If this becomes available
from the build-bot, that will probably be set by it.

You can use the hash from the tarball created locally; it should be identical to the tarball created by buildbots.

No, as I told you prior, I only build from source on master branch (and suggested you do the same). I don't use/never have used SDK or ImageBuilder, and have no idea what issues (if any) it would cause.

AFAIK buildbots use the SDKs to build packages. There are also snapshot SDKs built from master, I believe once a day.

Thanks! In researching the issue with rust-lang llvm-project branch, they date their branches, but then push updates (while not generating release tarballs), I ran across other issues reported where the sha256sum was changing based on the host. Apparently when Github changed/updated their backend, it started changing sha256sums and causing havoc.

jefferyto · 2022-04-22T18:03:55Z

You can use the hash from the tarball created locally; it should be identical to the tarball created by buildbots.

Thanks! In researching the issue with rust-lang llvm-project branch, they date their branches, but then push updates (while not generating release tarballs), I ran across other issues reported where the sha256sum was changing based on the host. Apparently when Github changed/updated their backend, it started changing sha256sums and causing havoc.

As part of building a package using a git checkout (instead of downloading a source tarball), buildroot will also create a tar.xz archive of the source code it downloaded. The archive should be in your "dl" directory, probably named "llvm-project-rustc-14.0.tar.xz". The sha256 hash of this file is the value for PKG_MIRROR_HASH.

Buildroot can also fill in the value for you if you do:

make package/llvm-project-rustc/check FIXUP=1 V=s

in building/linking rust-lang projects. We cannot use the existing OpenWrt eBPF LLVM toolchain for this. The eBPF LLVM toolchain only builds for eBPF, but we need the rust enhanced LLVM and support for AArch64, ARM, Mips, PowerPC, and X86. This LLVM is stored/preserved in staging_dir/host/llvm-rust and carries over a clean, requiring only a build once situation (unless the LLVM changes, or staging_dir gets removed). Used/Required for openwrt#18322 Signed-off-by: Donald Hoskins <grommish@gmail.com>

This is the rust enhanced/specific LLVM 14.0.0 toolchain, used in building/linking rust-lang projects. We cannot use the existing OpenWrt eBPF LLVM toolchain for this. The eBPF LLVM toolchain only builds for eBPF, but we need the rust enhanced LLVM and support for AArch64, ARM, Mips, PowerPC, and X86. This LLVM is stored/preserved in staging_dir/host/llvm-rust and carries over a clean, requiring only a build once situation (unless the LLVM changes, or staging_dir gets removed). Used/Required for openwrt#18322 Signed-off-by: Donald Hoskins <grommish@gmail.com>

Rust-lang toolchain is divided into two separate parts: Build HOST and TARGET toolchains. The HOST toolchain is persistent in STAGING_DIR_HOST and compiled rustc/cargo for use by the TARGET toolchains which require MUSL specific tags. This package requires the rust specific LLVM (openwrt#18322) PR to build and is a dependent for rust-lang TARGET toolchain (openwrt#13916) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Rust is a multi-paradigm, general-purpose programming language designed for performance and safety, especially safe concurrency. It is syntactically similar to C++, but can guarantee memory safety by using a borrow checker to validate references. This introduces support for an external rust-specific LLVM toolchain. This update introduces the following target tuples: mips64-openwrt-linux-musl (upstreamed) mips-openwrt-linux-musl mipsel-openwrt-linux-musl aarch64-openwrt-linux-musl arm-openwrt-linux-muslgnueabi arm-openwrt-linux-muslgnueabihf armv5tej-openwrt-linux-muslgnueabi armv6k-openwrt-linu8x-muslgnueabi armv7-openwrt-linux-muslgnueabi armv7-openwrt-linux-muslgnueabihf This PR requires/depends on the rust-lang specific LLVM (openwrt#18322) and rust-lang rust_host (openwrt#18453) Initial testing and support for: powerpc64-openwrt-linux-musl x86_64-openwrt-linux-musl Signed-off-by: Donald Hoskins <grommish@gmail.com>

This is the rust enhanced/specific LLVM 14.0.0 toolchain, used in building/linking rust-lang projects. We cannot use the existing OpenWrt eBPF LLVM toolchain for this. The eBPF LLVM toolchain only builds for eBPF, but we need the rust enhanced LLVM and support for AArch64, ARM, Mips, PowerPC, and X86. This LLVM is stored/preserved in staging_dir/host/llvm-rust and carries over a clean, requiring only a build once situation (unless the LLVM changes, or staging_dir gets removed). Signed-off-by: Donald Hoskins <grommish@gmail.com>

Grommish · 2022-05-05T19:04:50Z

Updated Integration into the build system to remove the need for LD_LIBRARY_PATH flags and fully integrated the libLLVM-14.0.so into the build system

Used for rust_host (#18453) and rust-lang (#13916)

bandwhich is a terminal bandwidth monitoring utility This package requires llvm-project-rustc (openwrt#18322), rust_host (openwrt#18453) and rust-lang (openwrt#13916) Signed-off-by: Donald Hoskins <grommish@gmail.com>

bottom is a CLI graphical process/system monitor. This package requires llvm-project-rustc (openwrt#18322), rust_host (openwrt#18453) and rust-lang (openwrt#13916) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Ripgrep recursively searches directories for a regex pattern while respecting your gitignore This package requires llvm-project-rustc (openwrt#18322), rust_host (openwrt#18453) and rust-lang (openwrt#13916) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Move rust-host PR (openwrt#18453) into existing rust-lang PR for cleanliness issues. This adds powerpc-openwrt-linux-musl support Still requires LLVM-Project-Rustc (openwrt#18322) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Rust is a multi-paradigm, general-purpose programming language designed for performance and safety, especially safe concurrency. It is syntactically similar to C++, but can guarantee memory safety by using a borrow checker to validate references. This introduces support for an external rust-specific LLVM toolchain. This update introduces the following target tuples: mips64-openwrt-linux-musl (upstreamed) mips-openwrt-linux-musl mipsel-openwrt-linux-musl aarch64-openwrt-linux-musl arm-openwrt-linux-muslgnueabi arm-openwrt-linux-muslgnueabihf armv5tej-openwrt-linux-muslgnueabi armv6k-openwrt-linu8x-muslgnueabi armv7-openwrt-linux-muslgnueabi armv7-openwrt-linux-muslgnueabihf This PR requires/depends on the rust-lang specific LLVM (openwrt#18322) and rust-lang rust_host (openwrt#18453) Initial testing and support for: powerpc64-openwrt-linux-musl x86_64-openwrt-linux-musl Signed-off-by: Donald Hoskins <grommish@gmail.com>

Move rust-host PR (openwrt#18453) into existing rust-lang PR for cleanliness issues. This adds powerpc-openwrt-linux-musl support Still requires LLVM-Project-Rustc (openwrt#18322) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Grommish · 2022-05-19T12:17:45Z

Closed - Rolled into #13916

Rust is a multi-paradigm, general-purpose programming language designed for performance and safety, especially safe concurrency. It is syntactically similar to C++, but can guarantee memory safety by using a borrow checker to validate references. This introduces support for an external rust-specific LLVM toolchain. This update introduces the following target tuples: mips64-openwrt-linux-musl (upstreamed) mips-openwrt-linux-musl mipsel-openwrt-linux-musl aarch64-openwrt-linux-musl arm-openwrt-linux-muslgnueabi arm-openwrt-linux-muslgnueabihf armv5tej-openwrt-linux-muslgnueabi armv6k-openwrt-linu8x-muslgnueabi armv7-openwrt-linux-muslgnueabi armv7-openwrt-linux-muslgnueabihf This PR requires/depends on the rust-lang specific LLVM (openwrt#18322) and rust-lang rust_host (openwrt#18453) Initial testing and support for: powerpc64-openwrt-linux-musl x86_64-openwrt-linux-musl Signed-off-by: Donald Hoskins <grommish@gmail.com>

Move rust-host PR (openwrt#18453) into existing rust-lang PR for cleanliness issues. This adds powerpc-openwrt-linux-musl support Still requires LLVM-Project-Rustc (openwrt#18322) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Rust is a multi-paradigm, general-purpose programming language designed for performance and safety, especially safe concurrency. It is syntactically similar to C++, but can guarantee memory safety by using a borrow checker to validate references. This introduces support for an external rust-specific LLVM toolchain. This update introduces the following target tuples: mips64-openwrt-linux-musl (upstreamed) mips-openwrt-linux-musl mipsel-openwrt-linux-musl aarch64-openwrt-linux-musl arm-openwrt-linux-muslgnueabi arm-openwrt-linux-muslgnueabihf armv5tej-openwrt-linux-muslgnueabi armv6k-openwrt-linu8x-muslgnueabi armv7-openwrt-linux-muslgnueabi armv7-openwrt-linux-muslgnueabihf This PR requires/depends on the rust-lang specific LLVM (openwrt#18322) and rust-lang rust_host (openwrt#18453) Initial testing and support for: powerpc64-openwrt-linux-musl x86_64-openwrt-linux-musl Signed-off-by: Donald Hoskins <grommish@gmail.com>

Move rust-host PR (openwrt#18453) into existing rust-lang PR for cleanliness issues. This adds powerpc-openwrt-linux-musl support Still requires LLVM-Project-Rustc (openwrt#18322) Signed-off-by: Donald Hoskins <grommish@gmail.com>

Grommish mentioned this pull request Apr 18, 2022

rust: Initial commit - rust lang #13916

Closed

Grommish force-pushed the llvm-project-rustc branch from 192961c to 015deed Compare April 18, 2022 16:12

Grommish force-pushed the llvm-project-rustc branch from 860bf63 to c4cebe3 Compare April 30, 2022 10:45

Grommish force-pushed the llvm-project-rustc branch from c4cebe3 to 81151da Compare May 1, 2022 17:42

Grommish mentioned this pull request May 5, 2022

Rust-lang: Rust 1.60.0 Build HOST Toolchain #18453

Closed

Grommish force-pushed the llvm-project-rustc branch from 81151da to 2509795 Compare May 5, 2022 19:01

Grommish marked this pull request as ready for review May 7, 2022 22:04

Grommish closed this May 19, 2022

Conversation

Grommish commented Apr 18, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Grommish commented Apr 18, 2022

Uh oh!

champtar commented Apr 18, 2022

Uh oh!

Grommish commented Apr 19, 2022

Uh oh!

Grommish commented Apr 19, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

Grommish commented Apr 20, 2022 via email

Uh oh!

openwrtfirmwarecostum commented Apr 20, 2022

Uh oh!

jefferyto commented Apr 22, 2022

Uh oh!

Grommish commented Apr 22, 2022

Uh oh!

jefferyto commented Apr 22, 2022

Uh oh!

Grommish commented May 5, 2022

Uh oh!

Grommish commented May 19, 2022

Uh oh!

Reviewers

Assignees

Grommish commented Apr 18, 2022 •

edited

Loading

Grommish commented Apr 20, 2022 •

edited

Loading

Grommish commented Apr 20, 2022 •

edited

Loading

Grommish commented Apr 20, 2022 •

edited

Loading

Grommish commented Apr 20, 2022 •

edited

Loading