Skip to content

Conversation

@akapoor3518
Copy link

@akapoor3518 akapoor3518 commented Oct 23, 2025

RUnning the build will add output for ggml.sh

100%] Built target llama-export-lora
creating tar bundle for fpga
creating tsi-ggml
tsi-ggml/blobs/
tsi-ggml/blobs/txe_abs.blob
tsi-ggml/blobs/txe_neg.blob
tsi-ggml/blobs/txe_sqrt.blob
tsi-ggml/blobs/txe_sqr.blob
tsi-ggml/blobs/txe_inv.blob
tsi-ggml/blobs/txe_sin.blob
tsi-ggml/blobs/txe_sigmoid.blob
tsi-ggml/blobs/txe_silu.blob
tsi-ggml/blobs/txe_swiglu.blob
tsi-ggml/blobs/txe_rms_norm.blob
tsi-ggml/blobs/txe_soft_max.blob
tsi-ggml/blobs/txe_add_16.blob
tsi-ggml/blobs/txe_sub_16.blob
tsi-ggml/blobs/txe_mult_16.blob
tsi-ggml/blobs/txe_div_16.blob
tsi-ggml/blobs/txe_abs_16.blob
tsi-ggml/blobs/txe_neg_16.blob
tsi-ggml/blobs/txe_sqrt_16.blob
tsi-ggml/blobs/txe_sqr_16.blob
tsi-ggml/blobs/txe_inv_16.blob
tsi-ggml/blobs/txe_sin_16.blob
tsi-ggml/blobs/txe_sigmoid_16.blob
tsi-ggml/blobs/txe_silu_16.blob
tsi-ggml/blobs/txe_swiglu_16.blob
tsi-ggml/blobs/txe_rms_norm_16.blob
tsi-ggml/blobs/txe_add.blob
tsi-ggml/blobs/txe_sub.blob
tsi-ggml/blobs/txe_mult.blob
tsi-ggml/blobs/txe_div.blob
tsi-ggml/ggml.sh
tsi-ggml/libggml-base.so
tsi-ggml/libggml-cpu.so
tsi-ggml/libggml.so
tsi-ggml/libggml-tsavorite.so
tsi-ggml/libllama.so
tsi-ggml/llama-cli
tsi-ggml/simple-backend-tsi
[akapoor@wssw01 llama.cpp]$ vi ggml.sh
[akapoor@wssw01 llama.cpp]$ cd tsi-ggml/
[akapoor@wssw01 tsi-ggml]$ cat ggml.sh
#!/bin/bash

Set up library paths for GCC 13.3.0 compatibility

export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$(pwd)

tsi_kernels=("add" "sub" "mult" "div" "abs" "inv" "neg" "sin" "sqrt" "sqr" "sigmoid" "silu" "rms_norm" "swiglu" "add_16" "sub_16" "mult_16" "div_16" "abs_16" "inv_16" "neg_16" "sin_16" "sqrt_16" "sqr_16" "sigmoid_16" "silu_16" "rms_norm_16" "swiglu_16")

for kernel in "${tsi_kernels[@]}"; do
mkdir -p /proj/work/akapoor/llama.cpp-oct22/llama.cpp/ggml-tsi-kernel/fpga-kernel/build-fpga/txe_$kernel
cp blobs /proj/work/akapoor/llama.cpp-oct22/llama.cpp/ggml-tsi-kernel/fpga-kernel/build-fpga/txe_$kernel/ -r
done
[akapoor@wssw01 tsi-ggml]$

@akapoor3518 akapoor3518 merged commit 3b74066 into master Oct 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants