FFI::DynamicLibrary.load_library': Could not open library

[mensfeld]

And here we go. First issue.

And yes, native extensions ARE HARD

/home//vendor/bundle/ruby/3.4.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi/dynamic_library.rb:94:in 'FFI::DynamicLibrary.load_library': 
Could not open library '/home//vendor/bundle/ruby/3.4.0/gems/karafka-rdkafka-0.20.0-x86_64-linux-gnu/lib/rdkafka/../../ext/librdkafka.so': 
/lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found 
(required by /home//vendor/bundle/ruby/3.4.0/gems/karafka-rdkafka-0.20.0-x86_64-linux-gnu/lib/rdkafka/../../ext/librdkafka.so). 
(LoadError)

[mensfeld]

Ok i need to compile it with a compatibility mode on older glibc. doable 🕶️

[mensfeld]

ref: #648 already merged in the karafka version (which I know I need to merge into one 😓 )

[ttstarck]

We're still seeing this issue on rdkafka-ruby version 0.22.2.

OS: Debian 11
Ruby Version: 3.3.8 (and 3.4.4).

LoadError:
--
  | Could not open library '/usr/local/bundle/ruby/3.3.0/gems/rdkafka-0.22.2-x86_64-linux-gnu/lib/rdkafka/../../ext/librdkafka.so': /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by /usr/local/bundle/ruby/3.3.0/gems/rdkafka-0.22.2-x86_64-linux-gnu/lib/rdkafka/../../ext/librdkafka.so).
  | Searched in <system library path>
  | # /usr/local/bundle/ruby/3.3.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi/dynamic_library.rb:94:in `load_library'
  | # /usr/local/bundle/ruby/3.3.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi/library.rb:95:in `block in ffi_lib'
  | # /usr/local/bundle/ruby/3.3.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi/library.rb:94:in `map'
  | # /usr/local/bundle/ruby/3.3.0/gems/ffi-1.17.2-x86_64-linux-gnu/lib/ffi/library.rb:94:in `ffi_lib'
  | # /usr/local/bundle/ruby/3.3.0/gems/rdkafka-0.22.2-x86_64-linux-gnu/lib/rdkafka/bindings.rb:16:in `<module:Bindings>'
  | # /usr/local/bundle/ruby/3.3.0/gems/rdkafka-0.22.2-x86_64-linux-gnu/lib/rdkafka/bindings.rb:5:in `<module:Rdkafka>'
  | # /usr/local/bundle/ruby/3.3.0/gems/rdkafka-0.22.2-x86_64-linux-gnu/lib/rdkafka/bindings.rb:3:in `<top (required)>'
  | # /usr/local/bundle/ruby/3.3.0/gems/rdkafka-0.22.2-x86_64-linux-gnu/lib/rdkafka.rb:34:in `<top (required)>'

[ttstarck]

I see now that the supported platforms for rdkafka's native extensions is Debian 12+ per this doc

Supported Platforms

rdkafka-ruby ships native extensions for the following platforms:

Platform	Architecture	Minimum Version	glibc/musl	Compatible Distributions
Linux (glibc)	x86_64	Ubuntu 22.04 LTS	glibc 2.35+	Ubuntu 22.04+, CentOS 9+, RHEL 9+, Debian 12+, Fedora 36+
Linux (musl)	x86_64	Alpine 3.18+	musl 1.2.4+	Alpine 3.18+, and other musl-based distributions
macOS	arm64	macOS 14+	N/A	Apple Silicon Macs (M1, M2, M3+)

[mensfeld]

@ttstarck Debian 12+ yes, with glibc of ** minimum **' GLIBC_2.33'. I don't want to go lower than that because it's a PITA. Happy to accept a PR that would make it work without compromising maintainability, though.

[mensfeld]

I do say in docs glibc 2.35 just to be on the safe side ;)

[mensfeld]

I'll make this error more descriptive: ref #654