[BUG]: macOS ARM64 Native Library Loading Failure

[jchristn]

Description

IMPORTANT Claude Code helped write the issue summary, so please forgive any factual inaccuracies that I couldn't personally verify. I couldn't find a duplicate bug other than issue #1276 but I assume that might be Unity-specific.

Summary

Issue: LlamaSharp.Backend.Cpu v0.25.0 fails to load on macOS ARM64 due to broken @rpath references in the native library dependencies.

Impact: Could not initialize on macOS ARM64 without manual post-build fixes.

Environment

System Information

macOS Version: Sonoma 15.6
Architecture: arm64 (Apple Silicon M2 Max)
Processor: Apple M2 Max
.NET Version: 9.0.8
.NET RID: osx-arm64

Package Versions

<PackageReference Include="LLamaSharp" Version="0.25.0" />
<PackageReference Include="LLamaSharp.Backend.Cpu" Version="0.25.0" />

Problem Description

Observed Behavior

When attempting to use LlamaSharp on macOS ARM64, the application fails during native library initialization with the following exception:

System.TypeInitializationException: The type initializer for 'LLama.Native.NativeApi' threw an exception.
 ---> LLama.Exceptions.RuntimeError: The native library cannot be correctly loaded. It could be one of the following reasons:
1. No LLamaSharp backend was installed. Please search LLamaSharp.Backend and install one of them.
2. You are using a device with only CPU but installed cuda backend. Please install cpu backend instead.
3. One of the dependency of the native library is missed. Please use `ldd` on linux, `dumpbin` on windows and `otool`to check if all the dependency of the native library is satisfied. Generally you could find the libraries under your output folder.
4. Try to compile llama.cpp yourself to generate a libllama library, then use `LLama.Native.NativeLibraryConfig.WithLibrary` to specify it at the very beginning of your code.

   at LLama.Native.NativeApi..cctor()
   at LLama.Native.NativeApi.llama_max_devices()

Expected Behavior

The native library should load successfully when:

1. LLamaSharp.Backend.Cpu NuGet package is installed
2. Application is built and published
3. NativeLibraryConfig.All.WithLibrary() is called with the correct path

This works correctly on Windows x64. I have yet to test on Linux.

---

Root Cause Analysis

Issue 1: Broken @rpath References

The libllama.dylib library in the NuGet package uses @rpath to reference its dependencies:

$ otool -L runtimes/osx-arm64/native/libllama.dylib

libllama.dylib:
    @rpath/libllama.dylib (compatibility version 0.0.0, current version 0.0.0)
    @rpath/libggml.dylib (compatibility version 0.0.0, current version 0.0.0)
    @rpath/libggml-cpu.dylib (compatibility version 0.0.0, current version 0.0.0)
    @rpath/libggml-blas.dylib (compatibility version 0.0.0, current version 0.0.0)
    @rpath/libggml-metal.dylib (compatibility version 0.0.0, current version 0.0.0)
    @rpath/libggml-base.dylib (compatibility version 0.0.0, current version 0.0.0)
    /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 1700.255.5)
    /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1345.120.2)

Problem: When .NET's P/Invoke loads libllama.dylib, it does NOT set the runtime path (@rpath) to include the directory containing the library. This causes macOS to fail finding the dependent libggml*.dylib files, even though they exist in the same directory.

Error from dlopen:

dlopen() failed: Library not loaded: @rpath/libggml.dylib
  Referenced from: <UUID> /path/to/libllama.dylib
  Reason: tried: '/Users/runner/work/LLamaSharp/LLamaSharp/build/bin/libggml.dylib' (no such file)

Notice it's looking in /Users/runner/work/LLamaSharp/LLamaSharp/build/bin/ - this is the path from the CI/CD build machine, not the user's machine.

Issue 2: Hardcoded Build Paths

The error message reveals that the libraries were built with a hardcoded rpath pointing to the GitHub Actions runner path:

• /Users/runner/work/LLamaSharp/LLamaSharp/build/bin/

This path doesn't exist on end-user machines.

---

Reproduction Steps

Minimal Reproduction

1. Create new .NET console application:

   dotnet new console -n LlamaSharpTest
   cd LlamaSharpTest

2. Add LlamaSharp packages:

   dotnet add package LLamaSharp --version 0.25.0
   dotnet add package LLamaSharp.Backend.Cpu --version 0.25.0

3. Add test code:

   using LLama.Native;
   
   Console.WriteLine("Configuring LlamaSharp for macOS ARM64...");
   
   // Get the native library path
   var libPath = Path.Combine(
       AppContext.BaseDirectory,
       "runtimes", "osx-arm64", "native", "libllama.dylib"
   );
   
   Console.WriteLine($"Library path: {libPath}");
   Console.WriteLine($"Exists: {File.Exists(libPath)}");
   
   // Configure library
   NativeLibraryConfig.All.WithLibrary(libPath, "llama");
   Console.WriteLine("Library configured successfully");
   
   // Try to use it - THIS WILL FAIL
   try
   {
       long devices = NativeApi.llama_max_devices();
       Console.WriteLine($"Devices: {devices}");
   }
   catch (Exception ex)
   {
       Console.WriteLine($"ERROR: {ex.GetType().Name}");
       Console.WriteLine($"Message: {ex.Message}");
       if (ex.InnerException != null)
       {
           Console.WriteLine($"Inner: {ex.InnerException.Message}");
       }
   }

4. Build and run:

   dotnet build
   dotnet run

Expected Output (Current - FAIL)

Configuring LlamaSharp for macOS ARM64...
Library path: /path/to/bin/Debug/net8.0/runtimes/osx-arm64/native/libllama.dylib
Exists: True
Library configured successfully
ERROR: TypeInitializationException
Message: The type initializer for 'LLama.Native.NativeApi' threw an exception.
Inner: The native library cannot be correctly loaded...

Expected Output (After Fix - PASS)

Configuring LlamaSharp for macOS ARM64...
Library path: /path/to/bin/Debug/net8.0/runtimes/osx-arm64/native/libllama.dylib
Exists: True
Library configured successfully
Devices: 0

---

Diagnostic Information

File Locations in NuGet Package

$ dotnet nuget locals global-packages --list
global-packages: /Users/username/.nuget/packages

$ find /Users/username/.nuget/packages/llamasharp.backend.cpu/0.25.0 -name "*.dylib"
.../runtimes/osx-arm64/native/libllama.dylib
.../runtimes/osx-arm64/native/libggml.dylib
.../runtimes/osx-arm64/native/libggml-cpu.dylib
.../runtimes/osx-arm64/native/libggml-blas.dylib
.../runtimes/osx-arm64/native/libggml-metal.dylib
.../runtimes/osx-arm64/native/libggml-base.dylib

✅ All required libraries ARE present in the NuGet package.

Dependency Analysis

$ cd bin/Debug/net8.0/runtimes/osx-arm64/native
$ otool -L libllama.dylib

libllama.dylib:
    @rpath/libllama.dylib (compatibility version 0.0.0, current version 0.0.0)
    @rpath/libggml.dylib ← PROBLEM: Uses @rpath
    @rpath/libggml-cpu.dylib ← PROBLEM: Uses @rpath
    @rpath/libggml-blas.dylib ← PROBLEM: Uses @rpath
    @rpath/libggml-metal.dylib ← PROBLEM: Uses @rpath
    @rpath/libggml-base.dylib ← PROBLEM: Uses @rpath
    /usr/lib/libc++.1.dylib ✓ OK: Absolute path
    /usr/lib/libSystem.B.dylib ✓ OK: Absolute path

Architecture Verification

$ file libllama.dylib
libllama.dylib: Mach-O 64-bit dynamically linked shared library arm64

$ lipo -info libllama.dylib
Non-fat file: libllama.dylib is architecture: arm64

✅ Library is correct ARM64 architecture.

Manual Load Test

$ cat > test.c << 'EOF'
#include <stdio.h>
#include <dlfcn.h>
int main() {
    void *h = dlopen("./libllama.dylib", RTLD_NOW);
    if (!h) { printf("ERROR: %s\n", dlerror()); return 1; }
    printf("SUCCESS\n");
    dlclose(h);
    return 0;
}
EOF

$ cc -o test test.c
$ ./test
ERROR: dlopen(./libllama.dylib, 0x0002): Library not loaded: @rpath/libggml.dylib
  Referenced from: <UUID> /path/to/libllama.dylib
  Reason: tried: '/Users/runner/work/LLamaSharp/LLamaSharp/build/bin/libggml.dylib' (no such file)

This proves the issue is in the library packaging, not in the .NET P/Invoke code.

---

Workaround

User-Side Fix

Users must manually fix the library references after every build:

cd bin/Debug/net8.0/runtimes/osx-arm64/native

install_name_tool -change @rpath/libggml.dylib @loader_path/libggml.dylib libllama.dylib
install_name_tool -change @rpath/libggml-cpu.dylib @loader_path/libggml-cpu.dylib libllama.dylib
install_name_tool -change @rpath/libggml-blas.dylib @loader_path/libggml-blas.dylib libllama.dylib
install_name_tool -change @rpath/libggml-metal.dylib @loader_path/libggml-metal.dylib libllama.dylib
install_name_tool -change @rpath/libggml-base.dylib @loader_path/libggml-base.dylib libllama.dylib

After fix:

$ otool -L libllama.dylib
libllama.dylib:
    @rpath/libllama.dylib
    @loader_path/libggml.dylib ✓ Fixed
    @loader_path/libggml-cpu.dylib ✓ Fixed
    @loader_path/libggml-blas.dylib ✓ Fixed
    @loader_path/libggml-metal.dylib ✓ Fixed
    @loader_path/libggml-base.dylib ✓ Fixed
    /usr/lib/libc++.1.dylib
    /usr/lib/libSystem.B.dylib

Verification:

$ ./test
SUCCESS  ← Now works!

---

Recommended Fix

For LlamaSharp Maintainers

The libraries should be built with @loader_path instead of @rpath for better portability with P/Invoke.

Option 1: Fix at Build Time (Preferred)

Modify the CMake or build script to use @loader_path:

# In CMakeLists.txt or build script:
if(APPLE)
    set_target_properties(llama PROPERTIES
        INSTALL_RPATH "@loader_path"
        BUILD_WITH_INSTALL_RPATH TRUE
    )

    # For each dependency
    set_target_properties(ggml PROPERTIES
        INSTALL_NAME_DIR "@loader_path"
    )
endif()

Or use linker flags:

-install_name @loader_path/libggml.dylib
-install_name @loader_path/libggml-cpu.dylib
# etc...

Option 2: Fix After Build (Post-Processing)

Add a post-build step in the NuGet packaging script:

# In package build script
if [ "$(uname)" = "Darwin" ]; then
    cd runtimes/osx-arm64/native

    # Fix all @rpath references to @loader_path
    install_name_tool -change @rpath/libggml.dylib @loader_path/libggml.dylib libllama.dylib
    install_name_tool -change @rpath/libggml-cpu.dylib @loader_path/libggml-cpu.dylib libllama.dylib
    install_name_tool -change @rpath/libggml-blas.dylib @loader_path/libggml-blas.dylib libllama.dylib
    install_name_tool -change @rpath/libggml-metal.dylib @loader_path/libggml-metal.dylib libllama.dylib
    install_name_tool -change @rpath/libggml-base.dylib @loader_path/libggml-base.dylib libllama.dylib
fi

References

Apple Documentation

• Dynamic Library Programming Topics
• install_name_tool man page
• dyld man page

Related Issues

• Similar .NET P/Invoke issues: dotnet/runtime#43408
• macOS rpath best practices: cmake.org/cmake/help/latest/prop_tgt/INSTALL_RPATH

---

Reproduction Repository

A minimal reproduction case has been prepared at:
https://github.com/jchristn/sharpai (see INSTALLING-ON-MAC-ARM64.md)

The repository includes:

• Working application (with workaround)
• Diagnostic scripts
• Detailed troubleshooting guide
• Automated fix script for users

---

Contact

Reported By: Joel Christner (jchristn)
Date: 2025-10-10
Project: SharpAI (https://github.com/jchristn/sharpai)
LlamaSharp Version: 0.25.0
Platform: macOS ARM64 (Apple Silicon)

---

Summary for Developers

Problem: @rpath references in libllama.dylib don't resolve when loaded via .NET P/Invoke on macOS ARM64.

Root Cause: .NET doesn't set runtime path for P/Invoke libraries; @rpath points to non-existent CI build path.

Fix: Change @rpath references to @loader_path in the macOS ARM64 build.

Effort: Low - Single build script change or post-build step.

Impact: Fixes completely broken macOS ARM64 support.

Urgency: High - Affects all macOS ARM64 users (large and growing platform).

---

**Thank you for maintaining LlamaSharp! This is a fantastic project and we appreciate your work. 🙏

Reproduction Steps

If you'd like to reproduce with my actual code, please clone https://github.com/jchristn/sharpai (main). The branch feature/detection should work after applying the @rpath commands. To test in SharpAI, build it and run it, hit ctrl-c, edit the sharpai.json file to put in your HuggingFace API key, then send an Ollama pull model API request to it (which will download the GGUF and load the model). There is a postman collection in the root of the project which has the model names I'm using to pull, generate embeddings, and generate completions.

Environment & Configuration

• Operating system: Mac M2 Max with Sonoma 15.6
• .NET runtime version: 8.0, 9.0
• LLamaSharp version: 0.25.0
• CUDA version (if you are using cuda backend):
• CPU & GPU device:

Known Workarounds

@rpath commands as documented above

[jchristn]

In case it's helpful, here are some of the artifacts Claude Code created to get around some of the issues with @rpath references.

start-mac.sh

#!/bin/bash
#
# SharpAI.Server startup script for macOS
# Validates dependencies, fixes @rpath references, and launches the server
#

set -e

SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
cd "$SCRIPT_DIR"

echo "================================================"
echo "SharpAI.Server - macOS Startup"
echo "================================================"
echo ""

# Detect architecture
ARCH=$(uname -m)
if [ "$ARCH" = "x86_64" ]; then
    RID="osx-x64"
    AVX_VARIANT="avx2"
elif [ "$ARCH" = "arm64" ]; then
    RID="osx-arm64"
    AVX_VARIANT=""
else
    echo "ERROR: Unsupported architecture: $ARCH"
    exit 1
fi

echo "Detected architecture: $ARCH (RID: $RID)"
echo ""

# Determine native library directory
if [ "$ARCH" = "x86_64" ]; then
    NATIVE_DIR="runtimes/$RID/native/$AVX_VARIANT"
else
    NATIVE_DIR="runtimes/$RID/native"
fi

echo "Native library directory: $NATIVE_DIR"
echo ""

# Verify native library directory exists
if [ ! -d "$NATIVE_DIR" ]; then
    echo "ERROR: Native library directory not found: $NATIVE_DIR"
    echo ""
    echo "This may indicate the LLamaSharp backend package was not restored correctly."
    echo "Try running: dotnet restore"
    exit 1
fi

LIBLLAMA_PATH="$NATIVE_DIR/libllama.dylib"
if [ ! -f "$LIBLLAMA_PATH" ]; then
    echo "ERROR: libllama.dylib not found at: $LIBLLAMA_PATH"
    exit 1
fi

echo "Γ£ô Found libllama.dylib"

# For ARM64, verify and fix dependencies
if [ "$ARCH" = "arm64" ]; then
    echo ""
    echo "Checking ARM64 dependencies..."

    REQUIRED_DEPS=("libggml-base.dylib" "libggml-cpu.dylib" "libggml.dylib" "libggml-blas.dylib" "libggml-metal.dylib")
    MISSING_DEPS=0

    for dep in "${REQUIRED_DEPS[@]}"; do
        if [ -f "$NATIVE_DIR/$dep" ]; then
            echo "Γ£ô Found $dep"
        else
            echo "Γ£ù MISSING: $dep"
            MISSING_DEPS=$((MISSING_DEPS + 1))
        fi
    done

    if [ $MISSING_DEPS -gt 0 ]; then
        echo ""
        echo "ERROR: Missing $MISSING_DEPS required dependencies"
        echo ""
        echo "The LLamaSharp backend package may be incomplete for macOS ARM64."
        echo "Try restoring packages: dotnet restore"
        exit 1
    fi

    echo ""
    echo "Fixing @rpath references in libllama.dylib..."

    cd "$NATIVE_DIR" || exit 1

    FIXED=0
    DEPS_TO_FIX=("libggml.dylib" "libggml-cpu.dylib" "libggml-base.dylib" "libggml-blas.dylib" "libggml-metal.dylib")

    for dep in "${DEPS_TO_FIX[@]}"; do
        # Check if this dependency is referenced with @rpath
        if otool -L libllama.dylib 2>/dev/null | grep -q "@rpath/$dep"; then
            echo "  → Fixing: @rpath/$dep → @loader_path/$dep"
            install_name_tool -change "@rpath/$dep" "@loader_path/$dep" libllama.dylib 2>/dev/null || {
                echo "  Γ£ù Failed to fix $dep (may already be fixed)"
            }
            FIXED=$((FIXED + 1))
        else
            echo "  Γ£ô Already fixed: $dep"
        fi
    done

    cd "$SCRIPT_DIR" || exit 1

    if [ $FIXED -gt 0 ]; then
        echo ""
        echo "Fixed $FIXED @rpath reference(s)"
    fi
else
    # For x64, just verify basic dependencies exist
    echo ""
    echo "Verifying x64 dependencies..."

    BASIC_DEPS=("libggml.dylib" "libggml-cpu.dylib")
    for dep in "${BASIC_DEPS[@]}"; do
        if [ -f "$NATIVE_DIR/$dep" ]; then
            echo "Γ£ô Found $dep"
        else
            echo "! Warning: $dep not found (may not be required)"
        fi
    done
fi

echo ""
echo "All dependencies verified successfully"
echo ""
echo "================================================"
echo "Starting SharpAI.Server..."
echo "================================================"
echo ""

# Launch the server
exec ./SharpAI.Server "$@"

diagnose-mac.sh

#!/bin/bash
#
# macOS ARM64 Diagnostic Script for libllama.dylib
#

SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"

echo "================================================"
echo "SharpAI macOS ARM64 Diagnostics"
echo "================================================"
echo ""
echo "Script directory: $SCRIPT_DIR"
echo ""

# Detect architecture
ARCH=$(uname -m)
if [ "$ARCH" = "arm64" ]; then
    LIB_PATH="$SCRIPT_DIR/runtimes/osx-arm64/native/libllama.dylib"
else
    LIB_PATH="$SCRIPT_DIR/runtimes/osx-x64/native/avx2/libllama.dylib"
fi

echo "Detected architecture: $ARCH"
echo ""

echo "1. Checking if library exists..."
if [ -f "$LIB_PATH" ]; then
    echo "   Γ£ô Library found: $LIB_PATH"
    ls -lh "$LIB_PATH"
else
    echo "   Γ£ù Library NOT found at: $LIB_PATH"
    exit 1
fi

echo ""
echo "2. Checking library architecture..."
file "$LIB_PATH"
lipo -info "$LIB_PATH"

echo ""
echo "3. Checking library dependencies..."
otool -L "$LIB_PATH"

echo ""
echo "4. Checking for missing dependencies..."
echo "   (Checking if each dependency exists on the system)"
echo ""

MISSING=0
while IFS= read -r line; do
    # Extract library path (first column after tab)
    lib=$(echo "$line" | awk '{print $1}')

    # Skip the library itself
    if [[ "$lib" == *"libllama.dylib"* ]]; then
        continue
    fi

    # Skip empty lines
    if [ -z "$lib" ]; then
        continue
    fi

    # Check if it's a system library (starts with /)
    if [[ "$lib" == /* ]]; then
        if [ -f "$lib" ]; then
            echo "   Γ£ô Found: $lib"
        else
            echo "   Γ£ù MISSING: $lib"
            MISSING=$((MISSING + 1))
        fi
    else
        # Relative path - check common locations
        found=0
        for prefix in "/usr/lib" "/usr/local/lib" "/opt/homebrew/lib"; do
            if [ -f "$prefix/$lib" ]; then
                echo "   Γ£ô Found: $prefix/$lib"
                found=1
                break
            fi
        done
        if [ $found -eq 0 ]; then
            echo "   Γ£ù MISSING: $lib (searched /usr/lib, /usr/local/lib, /opt/homebrew/lib)"
            MISSING=$((MISSING + 1))
        fi
    fi
done < <(otool -L "$LIB_PATH" | tail -n +2)

echo ""
echo "5. Checking system frameworks..."
# Check for Accelerate framework (common dependency for ML libraries)
if [ -d "/System/Library/Frameworks/Accelerate.framework" ]; then
    echo "   Γ£ô Accelerate framework found"
else
    echo "   Γ£ù Accelerate framework missing"
fi

echo ""
echo "6. Checking .NET environment..."
dotnet --info | grep -E "RID|Version|OS"

echo ""
echo "7. Attempting to load library with dlopen..."
# Create a small test program
cat > /tmp/test_load.c << 'EOF'
#include <stdio.h>
#include <dlfcn.h>

int main(int argc, char *argv[]) {
    if (argc != 2) {
        fprintf(stderr, "Usage: %s <library_path>\n", argv[0]);
        return 1;
    }

    void *handle = dlopen(argv[1], RTLD_NOW);
    if (!handle) {
        fprintf(stderr, "dlopen() failed: %s\n", dlerror());
        return 1;
    }

    printf("Γ£ô Library loaded successfully with dlopen()\n");
    dlclose(handle);
    return 0;
}
EOF

# Compile and run
cc -o /tmp/test_load /tmp/test_load.c
/tmp/test_load "$LIB_PATH"
TEST_RESULT=$?

echo ""
echo "================================================"
echo "Summary"
echo "================================================"
if [ $MISSING -gt 0 ]; then
    echo "Γ£ù Found $MISSING missing dependencies"
    echo ""
    echo "RECOMMENDATION: Install missing dependencies using Homebrew"
    echo "  brew install <missing-library>"
elif [ $TEST_RESULT -ne 0 ]; then
    echo "Γ£ù Library dependencies satisfied but dlopen() failed"
    echo ""
    echo "This may indicate:"
    echo "  1. Library is for wrong architecture (check lipo -info output above)"
    echo "  2. Code signing issue (try: codesign --verify --verbose $LIB_PATH)"
    echo "  3. Library built with incompatible compiler/SDK version"
    echo ""
    echo "RECOMMENDATION: Try running under Rosetta 2 (x64 emulation):"
    echo "  arch -x86_64 dotnet run"
else
    echo "Γ£ô All checks passed!"
    echo ""
    echo "Library loads successfully with dlopen(), but .NET may have"
    echo "additional restrictions or issues with P/Invoke on this platform."
    echo ""
    echo "RECOMMENDATION: This may be a LlamaSharp/ARM64 compatibility issue."
    echo "  1. Try running under Rosetta 2: arch -x86_64 dotnet run"
    echo "  2. Check for LlamaSharp updates"
    echo "  3. Report issue to LlamaSharp GitHub"
fi

echo "================================================"

# Cleanup
rm -f /tmp/test_load.c /tmp/test_load

fix-mac-dependencies.sh

#!/bin/bash
#
# Fix macOS ARM64 Missing Dependencies
# Finds and copies missing libggml*.dylib files
#

set -e

SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
TARGET_DIR="$SCRIPT_DIR/runtimes/osx-arm64/native"
MISSING_LIBS=("libggml.dylib" "libggml-cpu.dylib" "libggml-blas.dylib" "libggml-metal.dylib" "libggml-base.dylib")

echo "================================================"
echo "Fixing macOS ARM64 Missing Dependencies"
echo "================================================"
echo ""
echo "Script directory: $SCRIPT_DIR"
echo "Target directory: $TARGET_DIR"
echo ""

# Check target directory exists
if [ ! -d "$TARGET_DIR" ]; then
    echo "ERROR: Target directory not found: $TARGET_DIR"
    exit 1
fi

echo "1. Searching for missing libraries..."
echo ""

# Search in current runtime directory
echo "   Searching in current runtime directory..."
FOUND_IN_BUILD=$(find "$SCRIPT_DIR/runtimes" -name "libggml*.dylib" -type f 2>/dev/null || true)

# Search in NuGet cache
echo "   Searching in NuGet cache..."
NUGET_GLOBAL=$(dotnet nuget locals global-packages --list 2>/dev/null | cut -d ' ' -f 2)
if [ -n "$NUGET_GLOBAL" ]; then
    FOUND_IN_NUGET=$(find "$NUGET_GLOBAL/llamasharp.backend.cpu" -name "libggml*.dylib" -type f 2>/dev/null || true)
else
    FOUND_IN_NUGET=""
fi

# Combine results
ALL_FOUND="$FOUND_IN_BUILD"$'\n'"$FOUND_IN_NUGET"

if [ -z "$ALL_FOUND" ] || [ "$ALL_FOUND" == $'\n' ]; then
    echo ""
    echo "ERROR: Could not find any libggml*.dylib files!"
    echo ""
    echo "Searched in:"
    echo "  - $SCRIPT_DIR/runtimes"
    if [ -n "$NUGET_GLOBAL" ]; then
        echo "  - $NUGET_GLOBAL/llamasharp.backend.cpu"
    fi
    echo ""
    echo "These files should be part of the LLamaSharp.Backend.Cpu NuGet package."
    echo ""
    echo "WORKAROUND: Try using x64 mode with Rosetta 2:"
    echo "  arch -x86_64 dotnet run"
    exit 1
fi

echo ""
echo "2. Found libraries:"
echo "$ALL_FOUND" | grep -v '^$'
echo ""

echo "3. Copying missing libraries to target directory..."
echo ""

COPIED=0
for lib in "${MISSING_LIBS[@]}"; do
    if [ -f "$TARGET_DIR/$lib" ]; then
        echo "   Γ£ô Already exists: $lib"
    else
        # Find this specific library
        SOURCE=$(echo "$ALL_FOUND" | grep -m 1 "/$lib$" || true)

        if [ -n "$SOURCE" ] && [ -f "$SOURCE" ]; then
            echo "   → Copying: $lib"
            echo "      From: $SOURCE"
            cp "$SOURCE" "$TARGET_DIR/"
            COPIED=$((COPIED + 1))
        else
            echo "   Γ£ù Not found: $lib"
        fi
    fi
done

echo ""
echo "4. Verifying all dependencies..."
echo ""

MISSING_COUNT=0
for lib in "${MISSING_LIBS[@]}"; do
    if [ -f "$TARGET_DIR/$lib" ]; then
        echo "   Γ£ô $lib"
    else
        echo "   Γ£ù MISSING: $lib"
        MISSING_COUNT=$((MISSING_COUNT + 1))
    fi
done

# Also check the main library
echo "   Γ£ô libllama.dylib (already present)"

echo ""
if [ $MISSING_COUNT -eq 0 ]; then
    echo "5. Fixing @rpath references with install_name_tool..."
    echo ""

    # Fix @rpath references in libllama.dylib to use @loader_path
    cd "$TARGET_DIR" || exit 1

    FIXED=0
    DEPS_TO_FIX=("libggml.dylib" "libggml-cpu.dylib" "libggml-base.dylib" "libggml-blas.dylib" "libggml-metal.dylib")

    for dep in "${DEPS_TO_FIX[@]}"; do
        # Check if this dependency is referenced in libllama.dylib
        if otool -L libllama.dylib | grep -q "@rpath/$dep"; then
            echo "   → Fixing: @rpath/$dep → @loader_path/$dep"
            install_name_tool -change "@rpath/$dep" "@loader_path/$dep" libllama.dylib
            FIXED=$((FIXED + 1))
        fi
    done

    echo ""
    echo "   Fixed $FIXED @rpath reference(s)"
    echo ""
    echo "================================================"
    echo "SUCCESS! All dependencies fixed"
    echo "================================================"
    echo ""
    echo "Now try running the server again:"
    echo "  cd ~/Code/SharpAI/src/SharpAI.Server"
    echo "  dotnet run"
    echo ""
else
    echo "================================================"
    echo "INCOMPLETE! Still missing $MISSING_COUNT dependencies"
    echo "================================================"
    echo ""
    echo "The missing libraries were not found in:"
    echo "  - Build output directory"
    echo "  - NuGet package cache"
    echo ""
    echo "This may indicate the LLamaSharp.Backend.Cpu package"
    echo "is incomplete for macOS ARM64."
    echo ""
    echo "WORKAROUND: Use Rosetta 2 (x64 emulation):"
    echo "  arch -x86_64 dotnet run"
    echo ""
fi