all the rubies, plus all the arches #134

YOU54F · 2023-07-08T10:27:58Z

builds all the rubies for all the things

arm64/aarch64 support on linux/macos
x86 & x86_64 support for windows
reproducible open source release pipeline for consistent builds
builds Ruby 2.6 through to Ruby 3.3.0
- Only went back to 2.6.10 for unofficial HomeBrew support on Linux aarch64
Add's a CLI installer so users can get traveling-ruby at their fingertips, if they just need a ruby runtime, without any additional packaging steps
Tests all the things
build musl variants of linux, both x86_64 / aarch64
OpenSSL 3.2.0 for Ruby >= 3.1.0 / OpenSSL 1.1.1w for Ruby < 3.1.0

Fork:- https://github.com/YOU54F/traveling-ruby

Travelling ruby updates for arm64/aarch64

OS	Architecture	Supported
OSX	x86_64	✅
OSX	aarch64 (arm)	✅
Linux (glibc)	x86_64	✅
Linux (glibc)	aarch64 (arm)	✅
Linux (musl)	x86_64	✅
Linux (musl)	aarch64 (arm)	✅
Windows	x86_64	✅
Windows	x86	✅
Windows	aarch64 (via x86 emulation)	✅

macos x86_64 binaries work as far back at 10.15 Catalina.

10.14 Mojave fails on libgmp

… libffi into build

name pkg_date ruby_version os arch size --- -------- -------------- -- ---- ---- traveling-ruby 20230528 2.6.10 linux arm64 8.5M traveling-ruby 20230528 3.0.4 linux arm64 8.9M traveling-ruby 20230528 3.1.0 linux arm64 8.9M traveling-ruby 20230528 3.1.0-preview1 linux arm64 8.9M traveling-ruby 20230528 3.1.1 linux arm64 8.9M traveling-ruby 20230528 3.1.2 linux arm64 8.9M traveling-ruby 20230528 3.2.2 linux arm64 7.8M traveling-ruby 20230528 3.3.0-preview1 linux arm64 7.8M

… static builds

Alpine

YOU54F · 2024-02-16T17:25:23Z

New release is out

Highlights

New rubies
New gems (mysql2) plus Gem updates
Bundler update
Runtime dep updates
New platforms
- New Alpine based holy-build box and musl based linux packages
New GH Workflows
- Updated GH action workflows, including macos-14

New Rubies

Ruby 3.3.0 Release

Bundler Update

Bundler updated to 2.5.3 for Ruby versions > 3
Bundled updated to 2.4.22 for Ruby versions < 3

New Gems plus Gem updates

mysql2 gem now prebuilt for linux/macos/alpine

    RedCloth (4.3.3)
    bcrypt (3.1.20)
    charlock_holmes (0.7.7)
    curses (1.4.4)
    daemons (1.4.1)
    escape_utils (1.3.0)
    eventmachine (1.2.7)
    fast-stemmer (1.0.2)
    ffi (1.16.3)
    hitimes (2.0.0)
    json (2.7.1)
    kgio (2.11.4)
    mini_portile2 (2.8.5)
    mysql2 (0.5.6)
    nio4r (2.7.0)
    nokogiri (1.16.2)
      mini_portile2 (~> 2.8.2)
      racc (~> 1.4)
    pg (1.5.4)
    posix-spawn (0.3.15)
    puma (6.4.2)
      nio4r (~> 2.0)
    racc (1.7.3)
    rack (2.2.8)
    raindrops (0.20.1)
    redcarpet (3.6.0)
    rexml (3.2.6)
    rugged (1.7.2)
    sqlite3 (1.7.2)
      mini_portile2 (~> 2.8.0)
    thin (1.8.2)
      daemons (~> 1.0, >= 1.0.9)
      eventmachine (~> 1.0, >= 1.0.4)
      rack (>= 1, < 3)
    unf_ext (0.0.9.1)
    unicorn (6.1.0)
      kgio (~> 2.6)
      raindrops (~> 0.7)
    yajl-ruby (1.4.3)

OpenSSL

Ruby versions lower than 3.1.0 are built with OpenSSL 1.1.1w
Ruby versions 3.1.0 or later are build with OpenSSL 3.2.0

Dependency Updates

Linux Runtime updates

CCACHE_VERSION=4.9
CMAKE_VERSION=3.28.1
CMAKE_MAJOR_VERSION=3.28
GCC_LIBSTDCXX_VERSION=9.3.0
ZLIB_VERSION=1.3
OPENSSL_VERSION=3.2.0
CURL_VERSION=8.5.0
GIT_VERSION=2.43.0
SQLITE_VERSION=3450000
SQLITE_YEAR=2024
MYSQL_LIB_VERSION=6.1.9
POSTGRESQL_VERSION=15.5
ICU_RELEASE_VERSION=74-1
ICU_FILE_VERSION=74_1
LIBSSH2_VERSION=1.11.0
LIBFFI_VERSION=3.4.4
LIBYAML_VERSION=0.2.5

MacOS Runtime updates

CCACHE_VERSION=4.9
CMAKE_VERSION=3.28.1
PKG_CONFIG_VERSION=0.29.2
AUTOCONF_VERSION=2.71
AUTOMAKE_VERSION=1.16.5
LIBTOOL_VERSION=2.4.7
OPENSSL_VERSION=3.2.0
NCURSES_VERSION=6.4
LIBEDIT_VERSION=20230828-3.1
LIBEDIT_DIR_VERSION=20230828-3.1
GMP_VERSION=6.3.0
GMP_DIR_VERSION=6.3.0
LIBFFI_VERSION=3.4.4
LIBYAML_VERSION=0.2.5
SQLITE3_VERSION=3450000
SQLITE3_VERSION_YEAR=2024
XZ_VERSION=5.4.5
MYSQL_LIB_VERSION=6.1.9
POSTGRESQL_VERSION=15.5
ICU_RELEASE_VERSION=74-1
ICU_FILE_VERSION=74_1
LIBSSH2_VERSION=1.11.0
LIBXML2_VERSION=2.9.14
LIBXSLT_VERSION=1.1.34

New Platforms

musl based traveling-ruby packages

Platforms
- aarch64-linux-musl
- x86_64-linux-musl
Uses alpine flavoured holy build box
- https://github.com/YOU54F/holy-build-box/tree/alpine
- Images published to DockerHub with -alpine suffix
  - https://hub.docker.com/r/you54f/holy-build-box/tags?page=1&name=alpine
- Builds against Alpine 3.15. Tested against 3.15 - 3.19
- Currently only built for OpenSSL 3.2.0 so Ruby 3.1.x +
Alpine Traveling Ruby builder images published to docker, with -alpine suffix
- https://hub.docker.com/r/you54f/traveling-ruby-builder-arm64/tags?page=1&name=alpine
- https://hub.docker.com/r/you54f/traveling-ruby-builder-x86_64/tags?page=1&name=alpine

YOU54F · 2024-04-18T20:44:12Z

So I took a diversion from Ruby for a bit, to port one of our Ruby apps to Rust.

I thought it would be nice to have a fall back in the cli for each command, to allow it to call the existing ruby cli app, by use of a flag or env var.

With the help of some cross-compilers, I was able to package the rust app, for more supported platform/arch combos than ruby.

That left me with the behaviour of having to tell users who are wanting to fallback to the ruby impl, but don't have a traveling-ruby runtime that they are 💩 out of luck, and stuck with my poorly written rust code. 🤮

What to do 🤔

💡 cross-compilation adventure with qemu, and a switch to ubuntu/alpine over centos 7, as they had multi-platform images available where centos 7 we were stuck only working builds for amd64/arm64.

Updates

New additions

Linux - i386 / s390x / ppc64le / riscv64
Musl variants of all Linux architectures
Windows arm64 (Ruby 3.1.4 only)
New gems (bigdecimal / psych / stringio)
support for building snapshot from branches or master from ruby releases for (macos/linux) or head from rubyinstaller2 releases (windows)

🚧- Your mileage may vary with new platforms
⚠️ - openssl 1.1 based builds have been dropped, so nothing earlier than 3.1.4 for linux/macos

Check out the pre-release here

Linux

Platform	Architecture	Musl	Glibc
ARMv8 64-bit (`arm64v8`)	ARMv8	✅	✅
Linux x86-64 (`amd64`)	x86-64	✅	✅
x86/i686 (`i386`)	x86/i686	✅	✅
IBM z Systems (`s390x`)	z Systems	✅	✅
IBM POWER8 (`ppc64le`)	POWER8	✅	✅
RISC-V 64-bit (`riscv64`)	RISC-V	✅	✅

Alpine binaries built against 3.15
- riscv64 built against 3.15 alpha
Ubuntu binaries built against 14.04 (glibc 2.19)
- ppc64le / s390x binaries against 16.04
- riscv64 binaries against 20.04

MacOS

Platform	Architecture	Supported
MacOS x86-64 (`darwin-x86_64`)	x86-64	✅
MacOS arm64 (`darwin-arm64`)	arm64	✅

macos x86_64 binaries - 10.15 Catalina onwards
macos arm64 binaries - 11.0 Big Sur onwards

Windows

Platform	Architecture	Supported
Windows x86-64 (`windows-x86_64`)	x86-64	✅
Windows x86 (`windows-x86`)	x86	✅
Windows arm64 (`windows-arm64`)	arm64	🚧

windows-arm64, ruby 3.1.4 only
🚧 Native extensions not currently supported
- Use ocran or aibika (forks of ocran) to build native extensions
Docker Support
- Nanoserver images, will work if libgmp from package is copied to C:\Windows\System32
Wine support
- x86_64 package fails on darwin-arm64 with unexpected ucrtbase.dll error
  - Workaround, use x86 package on darwin-arm64
Windows VM support
- x86_64 package fails when emulated in vm's on darwin-arm64 with unexpected ucrtbase.dll error
  - Workaround, use x86 package on darwin-arm64
  - Workaround, use arm64 package on darwin-arm64

YOU54F · 2024-04-18T20:57:07Z

Also I've been working on a traveling-ruby app builder built in rust, for end users, that will package up their app for any or all of the supported TR platforms.

Rust supports embedding files (so an archive) or directory (with rust-embed), and I've managed to eliminate the need for end users app wrappers, by directly invoking the ruby binary with the correct TR environment variables setup.

This means you can distribute your ruby app as a single file which self-extracts its contents and then executes.

It's similar in vein for ocra / ruby_packer which provide a single entry point, however each of those unpack to a temporary directory, which affects speeds (it takes a short while to unpack it every time, and that seems expensive for our use case, cli invocations of which there are highly likely to multiple in quick succession)

In order to support native extensions for windows in my end users app, I cheated a little bit, I used ocran, exploded the temp directory and provided a new wrapper script.

Not sure if it will be of use to others, but it's been scratching my itch of getting to learn more rust and made it easy for me to test out the new TR combos

utoppo · 2024-04-21T01:15:54Z

Also I've been working on a traveling-ruby app builder built in rust, for end users, that will package up their app for any or all of the supported TR platforms.

Rust supports embedding files (so an archive) or directory (with rust-embed), and I've managed to eliminate the need for end users app wrappers, by directly invoking the ruby binary with the correct TR environment variables setup.

This means you can distribute your ruby app as a single file which self-extracts its contents and then executes.

It's similar in vein for ocra / ruby_packer which provide a single entry point, however each of those unpack to a temporary directory, which affects speeds (it takes a short while to unpack it every time, and that seems expensive for our use case, cli invocations of which there are highly likely to multiple in quick succession)

In order to support native extensions for windows in my end users app, I cheated a little bit, I used ocran, exploded the temp directory and provided a new wrapper script.

Not sure if it will be of use to others, but it's been scratching my itch of getting to learn more rust and made it easy for me to test out the new TR combos

That really sounds great! Thank you so much for all the effort!

updates rubygems to 3.5.9 updates bundler to 2.5.9 note need to drop 3.1.7 openssl fails to build in linux, (3.1.4 okay)

plus gem updates ffi 1.17.0 (was 1.16.3) racc 1.8.0 (was 1.7.3) mini_portile2 2.8.7 (was 2.8.6) hitimes 3.0.0 (was 2.0.0) nio4r 2.7.3 (was 2.7.1) curses 1.4.6 (was 1.4.5) nokogiri 1.16.5 (was 1.16.4) sqlite3 2.0.2 (was 2.0.1) rexml 3.2.9 (was 3.2.6)

## fixes - mini_portile2 pin to 2.8.6 due to errors in 2.8.7 on macos ## gem updates rexml 3.3.0 (was 3.2.9) stringio 3.1.1 (was 3.1.0) nokogiri 1.16.6 (was 1.16.5)

charlock_holmes (0.7.9) rexml (3.3.2) drop unmaintained posix-spawn

bradgessler · 2024-11-16T00:23:19Z

I think I'm going to use this for https://terminalwire.com/, which uses the async Ruby libraries, including async-websockets. 😅

- curses (1.4.6) + curses (1.4.7) - json (2.7.2) + json (2.8.2) - nio4r (2.7.3) + nio4r (2.7.4) - pg (1.5.7) - psych (5.1.2) + pg (1.5.9) + psych (5.2.0) - puma (6.4.2) + puma (6.4.3) - rack (2.2.9) + rack (2.2.10) - rexml (3.3.7) + rexml (3.3.9) - sqlite3 (2.0.4) + sqlite3 (2.3.0) - stringio (3.1.1) + stringio (3.1.2)

Serhii Zhuha and others added 30 commits June 1, 2022 11:25

Bump Ruby version to 3.1.2

75afdff

Update Gemfile.lock

03c08c3

added support of arm64 architecture for OSX

b5fb0ad

OSX: build supported on x86_64 and arm64 platforms

4fd8c3a

Merge branch '3.1.2' of github.com:cloudaware/traveling-ruby

240c3fe

chore: Update Gemfile 20230529

96565e6

chore: Update RUBY_VERSIONS.txt to create multiple versions

79aec14

chore: update BUNDLER_VERSION to 2.4.10

79eb88d

chore: Update VERSION.txt 20230529

d0a8562

chore: rename script files to end with .sh

b6cfb33

chore: osx deployment target

1e55a2d

chore(osx): add 14.2 xcode path

402850d

chore(osx): enable sqlite, postgresql, mysql, disable warning supression

fc691f2

chore(osx): osx build tweaks

32fd77a

chore(win): use 7zz on windows

d2c2b45

chore(scripts): add scripts to list, unpack and test all output versions

d461a7c

chore(win): enable multi-arch builds

9f26400

chore(linux): allow cpucount to pass on darwin for x-plat builds

110d593

feat(linux): add linux-arm64 multi-version builds

b8d1552

chore(linux): build libffi and libyaml from source

5ef4b0e

chore(linux): --disable-install-doc only, no readline on ruby 3, copy…

c57980b

… libffi into build

chore(git): git ignores

4605558

chore(ci): cirrus multi builder WIP

5efa41b

cirrus packing

ea32bce

chore(ci): matrix version builder and mass builder

528f961

ci(matrix-linux-arm64): test matrix-linux-arm64

fe1a347

ci(matrix-linux-arm64): use docker next image with libffi and libyaml…

dc9d8e6

… static builds

ci(matrix-linux-arm64): package all working ruby builds for arm64

e34c102

ci(packager-linux-arm64): use next image

36839c0

YOU54F and others added 2 commits February 15, 2024 16:39

Merge pull request #2 from YOU54F/alpine

30774c2

Alpine

chore: rm .ruby-version and revert bundler to 2.5.3

e301092

YOU54F added 16 commits April 27, 2024 14:23

chore(deps): latest round of rubies due to cves

6c8c8d6

updates rubygems to 3.5.9 updates bundler to 2.5.9 note need to drop 3.1.7 openssl fails to build in linux, (3.1.4 okay)

!chore: drop ruby 3.0.x and lower, remove openssl 1.1

1ac7438

deps: add bigdecimal/psych/stringio

ca25096

osx: fixup build errors

b014cc2

chore(deps): ruby 3.3.3

0baf50a

## fixes - mini_portile2 pin to 2.8.6 due to errors in 2.8.7 on macos ## gem updates rexml 3.3.0 (was 3.2.9) stringio 3.1.1 (was 3.1.0) nokogiri 1.16.6 (was 1.16.5)

chore(ci): use setup-ruby@v1.180.0 for 3.3.3 on windows [skip ci]

33d2d02

deps: ruby 3.3.4

7ba1ee1

!deps(gems): gem updates charlock_holmes/rexml

c50b455

charlock_holmes (0.7.9) rexml (3.3.2) drop unmaintained posix-spawn

chore(ci): update ruby setup actions for ruby 3.3.4

feef682

chore(test): remove posix-spawn from test matrix

bac13b3

macos: add xcode 15.4 sdk path

8bbca13

chore: update gems + ruby 3.3.5 / 3.2.5 + bundler 2.5.18

a88bbbb

chore: drop windows to 3.3.4 / update rubygems version to 3.5.18

9913c99

chore: remove platform specific ffi gems from lockfile

455d61f

deps(win): bump to ruby 3.3.5

d55239c

YOU54F added 7 commits November 22, 2024 19:05

chore(deps): ruby 3.2.6 / 3.3.6

48cfaf9

chore: rel-20240904

679a701

chore(osx): update codepaths for 15.4 & 16.0 xcode (gha / cirrus)

1324b5f

chore(osx): build osx in gha on macos-13 as macos-12 will brownout

9474201

chore(osx): downgrade x86_64 macos-13 xcode to 15.2

9d4b7ed

chore(osx): use xcode 16 for cirrus

8b83970

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

all the rubies, plus all the arches #134

all the rubies, plus all the arches #134

YOU54F commented Jul 8, 2023 •

edited

Loading

YOU54F commented Feb 16, 2024

YOU54F commented Apr 18, 2024 •

edited

Loading

YOU54F commented Apr 18, 2024 •

edited

Loading

utoppo commented Apr 21, 2024

bradgessler commented Nov 16, 2024

all the rubies, plus all the arches #134

Are you sure you want to change the base?

all the rubies, plus all the arches #134

Conversation

YOU54F commented Jul 8, 2023 • edited Loading

Travelling ruby updates for arm64/aarch64

YOU54F commented Feb 16, 2024

Highlights

New Rubies

Bundler Update

New Gems plus Gem updates

OpenSSL

Dependency Updates

Linux Runtime updates

MacOS Runtime updates

New Platforms

YOU54F commented Apr 18, 2024 • edited Loading

Updates

Linux

MacOS

Windows

YOU54F commented Apr 18, 2024 • edited Loading

utoppo commented Apr 21, 2024

bradgessler commented Nov 16, 2024

YOU54F commented Jul 8, 2023 •

edited

Loading

YOU54F commented Apr 18, 2024 •

edited

Loading

YOU54F commented Apr 18, 2024 •

edited

Loading