Load libraries with dependencies in JNA (Java)

[TimReset]

Hi,
I'm trying to run JetBrains IDE in Termux.
IDEA 2023.1.5 is working, but I see JNA error in a log (it's not the same error from IDEA but with the same result):

Exception in thread "main" java.lang.UnsatisfiedLinkError: /data/data/com.termux/files/home/.cache/JNA/temp/jna15872201178952457224.tmp: dlopen failed: library "libc.so.6" not found: needed by /data/data/com.termux/files/home/.cache/JNA/temp/jna15872201178952457224.tmp in namespace (default)
        at java.base/jdk.internal.loader.NativeLibraries.load(Native Method)
        at java.base/jdk.internal.loader.NativeLibraries$NativeLibraryImpl.open(NativeLibraries.java:384)
        at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(NativeLibraries.java:228)
        at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(NativeLibraries.java:170)
        at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2389)
        at java.base/java.lang.Runtime.load0(Runtime.java:751)
        at java.base/java.lang.System.load(System.java:1912)
        at com.sun.jna.Native.loadNativeDispatchLibraryFromClasspath(Native.java:1045)
        at com.sun.jna.Native.loadNativeDispatchLibrary(Native.java:1015)
        at com.sun.jna.Native.<clinit>(Native.java:221)
        at Main.main(JnaTest.java:7)

It doesn't stop IDE loading but anyway I fixed it by recompiling JNA libjnidispatch.so and put it into IDE folder (IDEA folder\lib\jna\aaarch64)
Error was gone.
But I see next error - now JNA can't load dependencies of own lib. Here is a small example with error:

import com.sun.jna.Library;
import com.sun.jna.Native;
public class Main {
public interface Linux_Util_lib extends Library {
    int login_tty(int fd);
  }
  private static final Linux_Util_lib m_Utillib = Native.loadLibrary("util", Linux_Util_lib.class);
  public static void main(String[] args) {
        System.out.println(System.getProperty("java.library.path"));
        System.out.println(Native.LONG_SIZE);
    }
}

Result (need to run in proot env to have libutil.so lib):

root@localhost:/data/data/com.termux/files/home# java --class-path jna-5.13.0-my.jar JnaTest.java
Note: JnaTest.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Exception in thread "main" java.lang.UnsatisfiedLinkError: Unable to load library 'util':
dlopen failed: library "libutil.so" not found
dlopen failed: library "libutil.so" not found
dlopen failed: library "/lib/aarch64-linux-gnu/libutil.so.1" needed or dlopened by "/data/data/com.termux/files/home/.cache/JNA/temp/jna14866805044633004472.tmp" is not accessible for the namespace "(default)"
Native library (linux-aarch64/libutil.so) not found in resource path (jna-5.13.0-my.jar)
        at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:323)
        at com.sun.jna.NativeLibrary.getInstance(NativeLibrary.java:483)
        at com.sun.jna.Library$Handler.<init>(Library.java:197)
        at com.sun.jna.Native.loadLibrary(Native.java:672)
        at com.sun.jna.Native.loadLibrary(Native.java:656)
        at Main.<clinit>(JnaTest.java:10)
        at java.base/java.lang.Class.forName0(Native Method)
        at java.base/java.lang.Class.forName(Class.java:467)
        at jdk.compiler/com.sun.tools.javac.launcher.Main.execute(Main.java:409)
        at jdk.compiler/com.sun.tools.javac.launcher.Main.run(Main.java:192)
        at jdk.compiler/com.sun.tools.javac.launcher.Main.main(Main.java:132)
        Suppressed: java.lang.UnsatisfiedLinkError: dlopen failed: library "libutil.so" not found
                at com.sun.jna.Native.open(Native Method)
                at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:211)
                ... 10 more
        Suppressed: java.lang.UnsatisfiedLinkError: dlopen failed: library "libutil.so" not found
                at com.sun.jna.Native.open(Native Method)
                at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:224)
                ... 10 more
        Suppressed: java.lang.UnsatisfiedLinkError: dlopen failed: library "/lib/aarch64-linux-gnu/libutil.so.1" needed or dlopened by "/data/data/com.termux/files/home/.cache/JNA/temp/jna14866805044633004472.tmp" is not accessible for the namespace "(default)"
                at com.sun.jna.Native.open(Native Method)
                at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:255)
                ... 10 more
        Suppressed: java.io.IOException: Native library (linux-aarch64/libutil.so) not found in resource path (jna-5.13.0-my.jar)
                at com.sun.jna.Native.extractFromResourcePath(Native.java:1145)
                at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:295)
                ... 10 more

I use patched JNA version, with rebuilt libjnidispatch.so.
Looks like root cause is in
dlopen failed: library "/lib/aarch64-linux-gnu/libutil.so.1" needed or dlopened by "/data/data/com.termux/files/home/.cache/JNA/temp/jna14866805044633004472.tmp" is not accessible for the namespace "(default)"
As I understand - your own library can use shared library only from /data/data/com.termux/files/ path. I tried to fix that by moving that libs into home folder and using LD_LIBRARY_PATH but that produced other issue.

So, any idea how to fix that?

[twaik]

It is not possible to load glibc libraries with bionic java. You should use glibc-compiled java to load this (probably in proot or chroot distro).

[Maxython]

It's possible - termux-pacman/glibc-packages#61 (comment)

[twaik]

Yeah, only in the case of glibc java built for termux. But still there is a problem. Libraries he tries to load are referencing libraries in non-existent pathes.

[TimReset]

I finally managed to run CLion 2023.1.5 with debugger!

Long story short:

• need to build JNA lib in Termux. To do that, need to download it, install libffi.a (static libffi in Termux). JNA can't build own libffi.a - need to copy past it to expected path. Need to use the same JNA version as in IDEA. Need to use gcc, not clang.
• after that JNA will work but pty4j won't work (it's a next error). Need to download pty4j and build native lib.
• And need to change com.pty4j.unix.linux.OSFacadeImpl - move method com.pty4j.unix.linux.OSFacadeImpl.Linux_Util_lib#login_tty to com.pty4j.unix.linux.OSFacadeImpl.C_lib and remove com.pty4j.unix.linux.OSFacadeImpl#m_Utillib at all.
• after these steps need to replace \lib\jna\aarch64\libjnidispatch.so and \lib\pty4j\linux\aarch64\libpty.so with your new versions.
• and put your new pty4j into lib folder and add this lib as first lib in classpath in bin\idea.sh:
  CLASS_PATH="$IDE_HOME/lib/pty4j.0.12.13.jar:$IDE_HOME/lib/app.jar"

[twaik]

• Need to use the same JNA version as in IDEA. Need to use gcc, not clang.

As far as I know clang can not build some asm files, but they can be built with gnu binutils asm (in ubuntu it can be installed with sudo apt install -y binutils-aarch64-linux-gnu binutils-arm-linux-gnueabihf), also you will need to pass -fno-integrated-as -B /usr/aarch64-linux-gnu/bin to CFLAGS`.

I think this process can be optimized and automatized (put in build.sh and published as termux-glibc package?).