Skip to content

gguf-hash: add RVV tensor hashing using xxh3 #18576

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
ixgbe wants to merge 4 commits into
base: master
Choose a base branch
from
Open

gguf-hash: add RVV tensor hashing using xxh3 #18576

ixgbe wants to merge 4 commits into from
+264 −7

Conversation

@ixgbe
Copy link
Contributor

@ixgbe ixgbe commented Jan 4, 2026

Test environment: Spacemit(R) X60
Compile command: cmake -B build -DLLAMA_CURL=OFF -DCMAKE_BUILD_TYPE=Debug -DGGML_OPENMP=OFF -DLLAMA_BUILD_EXAMPLES=ON -DLLAMA_BUILD_TOOLS=ON -DLLAMA_BUILD_TESTS=ON -DGGML_CPU_REPACK=ON

root@yangwang:/home/yangwang/llama.cpp# /home/yangwang/llama.cpp/build/bin/llama-gguf-hash --xxh3 Llama-3.2-1B.Q4_0.gguf > Llama-3.2-1B.Q4_0.gguf.manifest
root@yangwang:/home/yangwang/llama.cpp# /home/yangwang/llama.cpp/build/bin/llama-gguf-hash --check Llama-3.2-1B.Q4_0.gguf.manifest --xxh3 Llama-3.2-1B.Q4_0.gguf

manifest  Llama-3.2-1B.Q4_0.gguf.manifest  xxh3
xxh3      5d5696d93cf7f23a  Llama-3.2-1B.Q4_0.gguf:rope_freqs.weight  -  Ok
xxh3      b6fe8275665bd2a7  Llama-3.2-1B.Q4_0.gguf:token_embd.weight  -  Ok
xxh3      3a739f2556e3c050  Llama-3.2-1B.Q4_0.gguf:blk.0.attn_norm.weight  -  Ok
xxh3      df8cec97953b6ffb  Llama-3.2-1B.Q4_0.gguf:blk.0.ffn_down.weight  -  Ok
xxh3      84c0652a7474b9a0  Llama-3.2-1B.Q4_0.gguf:blk.0.ffn_gate.weight  -  Ok
xxh3      6ea736f52728a839  Llama-3.2-1B.Q4_0.gguf:blk.0.ffn_up.weight  -  Ok
xxh3      545ef1c0d91b1371  Llama-3.2-1B.Q4_0.gguf:blk.0.ffn_norm.weight  -  Ok
xxh3      a868dfcb06296dd7  Llama-3.2-1B.Q4_0.gguf:blk.0.attn_k.weight  -  Ok
xxh3      f3e9a983727abacb  Llama-3.2-1B.Q4_0.gguf:blk.0.attn_output.weight  -  Ok
xxh3      e6eba958103617af  Llama-3.2-1B.Q4_0.gguf:blk.0.attn_q.weight  -  Ok
xxh3      6ffd9780454dafbd  Llama-3.2-1B.Q4_0.gguf:blk.0.attn_v.weight  -  Ok
xxh3      e0a595da05bac72e  Llama-3.2-1B.Q4_0.gguf:blk.1.attn_norm.weight  -  Ok
xxh3      54385a251b84762d  Llama-3.2-1B.Q4_0.gguf:blk.1.ffn_down.weight  -  Ok
xxh3      5d3f01ee625da375  Llama-3.2-1B.Q4_0.gguf:blk.1.ffn_gate.weight  -  Ok
xxh3      15d8a6f51ff77d2c  Llama-3.2-1B.Q4_0.gguf:blk.1.ffn_up.weight  -  Ok
xxh3      98636d8b157cf11d  Llama-3.2-1B.Q4_0.gguf:blk.1.ffn_norm.weight  -  Ok
xxh3      3b05b9c1a3d92342  Llama-3.2-1B.Q4_0.gguf:blk.1.attn_k.weight  -  Ok
xxh3      42a23d182e40a461  Llama-3.2-1B.Q4_0.gguf:blk.1.attn_output.weight  -  Ok
xxh3      d40dfabb067bb879  Llama-3.2-1B.Q4_0.gguf:blk.1.attn_q.weight  -  Ok
xxh3      10b4507184018a67  Llama-3.2-1B.Q4_0.gguf:blk.1.attn_v.weight  -  Ok
xxh3      082581b4aca0f892  Llama-3.2-1B.Q4_0.gguf:blk.10.attn_norm.weight  -  Ok
xxh3      ea5d59487a18d3bc  Llama-3.2-1B.Q4_0.gguf:blk.10.ffn_down.weight  -  Ok
xxh3      285808791b316075  Llama-3.2-1B.Q4_0.gguf:blk.10.ffn_gate.weight  -  Ok
xxh3      fbe3f75b25441bb2  Llama-3.2-1B.Q4_0.gguf:blk.10.ffn_up.weight  -  Ok
xxh3      f83ce491eb504811  Llama-3.2-1B.Q4_0.gguf:blk.10.ffn_norm.weight  -  Ok
xxh3      57c09ec26edcff93  Llama-3.2-1B.Q4_0.gguf:blk.10.attn_k.weight  -  Ok
xxh3      873cf4c835b52056  Llama-3.2-1B.Q4_0.gguf:blk.10.attn_output.weight  -  Ok
xxh3      ab1fd92d5ba2e78e  Llama-3.2-1B.Q4_0.gguf:blk.10.attn_q.weight  -  Ok
xxh3      f128d686afd57e67  Llama-3.2-1B.Q4_0.gguf:blk.10.attn_v.weight  -  Ok
xxh3      2618dd48639fe825  Llama-3.2-1B.Q4_0.gguf:blk.11.attn_norm.weight  -  Ok
xxh3      88926d4228fada69  Llama-3.2-1B.Q4_0.gguf:blk.11.ffn_down.weight  -  Ok
xxh3      8a8b95667b1b4fed  Llama-3.2-1B.Q4_0.gguf:blk.11.ffn_gate.weight  -  Ok
xxh3      636ab1ed21431e0a  Llama-3.2-1B.Q4_0.gguf:blk.11.ffn_up.weight  -  Ok
xxh3      1254fcbc6e93bdde  Llama-3.2-1B.Q4_0.gguf:blk.11.ffn_norm.weight  -  Ok
xxh3      d6d7902f849e3eba  Llama-3.2-1B.Q4_0.gguf:blk.11.attn_k.weight  -  Ok
xxh3      36e6bcf424b37d66  Llama-3.2-1B.Q4_0.gguf:blk.11.attn_output.weight  -  Ok
xxh3      b7243e2d516da8b1  Llama-3.2-1B.Q4_0.gguf:blk.11.attn_q.weight  -  Ok
xxh3      6cb3a8c097ef75d2  Llama-3.2-1B.Q4_0.gguf:blk.11.attn_v.weight  -  Ok
xxh3      f33e321061ec3183  Llama-3.2-1B.Q4_0.gguf:blk.12.attn_norm.weight  -  Ok
xxh3      4988e565dce5a381  Llama-3.2-1B.Q4_0.gguf:blk.12.ffn_down.weight  -  Ok
xxh3      c1ca66bcdf14d5a9  Llama-3.2-1B.Q4_0.gguf:blk.12.ffn_gate.weight  -  Ok
xxh3      57bc70a41f795fcb  Llama-3.2-1B.Q4_0.gguf:blk.12.ffn_up.weight  -  Ok
xxh3      a6ec8ad4c318c83f  Llama-3.2-1B.Q4_0.gguf:blk.12.ffn_norm.weight  -  Ok
xxh3      cec5d3f90fa17637  Llama-3.2-1B.Q4_0.gguf:blk.12.attn_k.weight  -  Ok
xxh3      b5f8137b169baa46  Llama-3.2-1B.Q4_0.gguf:blk.12.attn_output.weight  -  Ok
xxh3      947141b521e7d062  Llama-3.2-1B.Q4_0.gguf:blk.12.attn_q.weight  -  Ok
xxh3      9c504d98855a5dc5  Llama-3.2-1B.Q4_0.gguf:blk.12.attn_v.weight  -  Ok
xxh3      2fbbe443a10e084a  Llama-3.2-1B.Q4_0.gguf:blk.13.attn_norm.weight  -  Ok
xxh3      059f1ef199dced5e  Llama-3.2-1B.Q4_0.gguf:blk.13.ffn_down.weight  -  Ok
xxh3      ed1cde188667d3e7  Llama-3.2-1B.Q4_0.gguf:blk.13.ffn_gate.weight  -  Ok
xxh3      2e3cc6190f077796  Llama-3.2-1B.Q4_0.gguf:blk.13.ffn_up.weight  -  Ok
xxh3      4af8efec2927b4a3  Llama-3.2-1B.Q4_0.gguf:blk.13.ffn_norm.weight  -  Ok
xxh3      6af1dde2dde20703  Llama-3.2-1B.Q4_0.gguf:blk.13.attn_k.weight  -  Ok
xxh3      5b13d97405e84038  Llama-3.2-1B.Q4_0.gguf:blk.13.attn_output.weight  -  Ok
xxh3      21c389c124177556  Llama-3.2-1B.Q4_0.gguf:blk.13.attn_q.weight  -  Ok
xxh3      f128d04a1e6bb3bc  Llama-3.2-1B.Q4_0.gguf:blk.13.attn_v.weight  -  Ok
xxh3      674dc59e02c27eb8  Llama-3.2-1B.Q4_0.gguf:blk.14.attn_norm.weight  -  Ok
xxh3      dc1ad1931e7dc521  Llama-3.2-1B.Q4_0.gguf:blk.14.ffn_down.weight  -  Ok
xxh3      f38cc36b622af2ed  Llama-3.2-1B.Q4_0.gguf:blk.14.ffn_gate.weight  -  Ok
xxh3      8d9f1303f1a028b9  Llama-3.2-1B.Q4_0.gguf:blk.14.ffn_up.weight  -  Ok
xxh3      0b7edb754401fb45  Llama-3.2-1B.Q4_0.gguf:blk.14.ffn_norm.weight  -  Ok
xxh3      c59170962b7c7b21  Llama-3.2-1B.Q4_0.gguf:blk.14.attn_k.weight  -  Ok
xxh3      590331056d1552da  Llama-3.2-1B.Q4_0.gguf:blk.14.attn_output.weight  -  Ok
xxh3      090830bdddfcfce1  Llama-3.2-1B.Q4_0.gguf:blk.14.attn_q.weight  -  Ok
xxh3      89d7e778a2755467  Llama-3.2-1B.Q4_0.gguf:blk.14.attn_v.weight  -  Ok
xxh3      f4eee127f7d21ea7  Llama-3.2-1B.Q4_0.gguf:blk.15.attn_norm.weight  -  Ok
xxh3      bf4fc3fdedcea295  Llama-3.2-1B.Q4_0.gguf:blk.15.ffn_down.weight  -  Ok
xxh3      8eccf336536b0615  Llama-3.2-1B.Q4_0.gguf:blk.15.ffn_gate.weight  -  Ok
xxh3      acbc5f34088492d3  Llama-3.2-1B.Q4_0.gguf:blk.15.ffn_up.weight  -  Ok
xxh3      e021fd1d315f4d25  Llama-3.2-1B.Q4_0.gguf:blk.15.ffn_norm.weight  -  Ok
xxh3      9676b2a2be957fc1  Llama-3.2-1B.Q4_0.gguf:blk.15.attn_k.weight  -  Ok
xxh3      99c09862c97adeb5  Llama-3.2-1B.Q4_0.gguf:blk.15.attn_output.weight  -  Ok
xxh3      239701d1b3692a37  Llama-3.2-1B.Q4_0.gguf:blk.15.attn_q.weight  -  Ok
xxh3      2c60caa359e5133a  Llama-3.2-1B.Q4_0.gguf:blk.15.attn_v.weight  -  Ok
xxh3      0aac5fe69a9257ef  Llama-3.2-1B.Q4_0.gguf:blk.2.attn_norm.weight  -  Ok
xxh3      417811d76ba706cb  Llama-3.2-1B.Q4_0.gguf:blk.2.ffn_down.weight  -  Ok
xxh3      acc2d3ed0eb9a94b  Llama-3.2-1B.Q4_0.gguf:blk.2.ffn_gate.weight  -  Ok
xxh3      f20542a83e8934b6  Llama-3.2-1B.Q4_0.gguf:blk.2.ffn_up.weight  -  Ok
xxh3      e8e5f0d8de31c916  Llama-3.2-1B.Q4_0.gguf:blk.2.ffn_norm.weight  -  Ok
xxh3      cbab382ff23368fa  Llama-3.2-1B.Q4_0.gguf:blk.2.attn_k.weight  -  Ok
xxh3      c1b725ccf4963f21  Llama-3.2-1B.Q4_0.gguf:blk.2.attn_output.weight  -  Ok
xxh3      20f6dba79f369099  Llama-3.2-1B.Q4_0.gguf:blk.2.attn_q.weight  -  Ok
xxh3      93d384f1518d7f08  Llama-3.2-1B.Q4_0.gguf:blk.2.attn_v.weight  -  Ok
xxh3      63ef37ac1b2cf0ad  Llama-3.2-1B.Q4_0.gguf:blk.3.attn_norm.weight  -  Ok
xxh3      e301933e13735253  Llama-3.2-1B.Q4_0.gguf:blk.3.ffn_down.weight  -  Ok
xxh3      a3db73575eb9277a  Llama-3.2-1B.Q4_0.gguf:blk.3.ffn_gate.weight  -  Ok
xxh3      559423da2ea45145  Llama-3.2-1B.Q4_0.gguf:blk.3.ffn_up.weight  -  Ok
xxh3      bb73f08ca1aad3bc  Llama-3.2-1B.Q4_0.gguf:blk.3.ffn_norm.weight  -  Ok
xxh3      2471591de53b93f8  Llama-3.2-1B.Q4_0.gguf:blk.3.attn_k.weight  -  Ok
xxh3      e6f0b05e9c8aa4e6  Llama-3.2-1B.Q4_0.gguf:blk.3.attn_output.weight  -  Ok
xxh3      2e6563ed85d5f8e0  Llama-3.2-1B.Q4_0.gguf:blk.3.attn_q.weight  -  Ok
xxh3      1ef5109550c68a67  Llama-3.2-1B.Q4_0.gguf:blk.3.attn_v.weight  -  Ok
xxh3      12828dc7948c9386  Llama-3.2-1B.Q4_0.gguf:blk.4.attn_norm.weight  -  Ok
xxh3      560812e146bbb13e  Llama-3.2-1B.Q4_0.gguf:blk.4.ffn_down.weight  -  Ok
xxh3      a1960243bd42e060  Llama-3.2-1B.Q4_0.gguf:blk.4.ffn_gate.weight  -  Ok
xxh3      13d049cbb0666f61  Llama-3.2-1B.Q4_0.gguf:blk.4.ffn_up.weight  -  Ok
xxh3      396375836570a987  Llama-3.2-1B.Q4_0.gguf:blk.4.ffn_norm.weight  -  Ok
xxh3      9bcfffce4fcd52ae  Llama-3.2-1B.Q4_0.gguf:blk.4.attn_k.weight  -  Ok
xxh3      af5acf8616ea7155  Llama-3.2-1B.Q4_0.gguf:blk.4.attn_output.weight  -  Ok
xxh3      31ce0e1e8194f122  Llama-3.2-1B.Q4_0.gguf:blk.4.attn_q.weight  -  Ok
xxh3      95df0ec9a016cd1e  Llama-3.2-1B.Q4_0.gguf:blk.4.attn_v.weight  -  Ok
xxh3      caa8bcc458d60e9c  Llama-3.2-1B.Q4_0.gguf:blk.5.attn_norm.weight  -  Ok
xxh3      1996c95ccd37e05d  Llama-3.2-1B.Q4_0.gguf:blk.5.ffn_down.weight  -  Ok
xxh3      9871e99e93401f79  Llama-3.2-1B.Q4_0.gguf:blk.5.ffn_gate.weight  -  Ok
xxh3      a1920162c3e95e73  Llama-3.2-1B.Q4_0.gguf:blk.5.ffn_up.weight  -  Ok
xxh3      32f34170e18ebc87  Llama-3.2-1B.Q4_0.gguf:blk.5.ffn_norm.weight  -  Ok
xxh3      4ec2cf845d9937f0  Llama-3.2-1B.Q4_0.gguf:blk.5.attn_k.weight  -  Ok
xxh3      0d23ea161d38550a  Llama-3.2-1B.Q4_0.gguf:blk.5.attn_output.weight  -  Ok
xxh3      b28f43291da7d46b  Llama-3.2-1B.Q4_0.gguf:blk.5.attn_q.weight  -  Ok
xxh3      9c74df25a49ca354  Llama-3.2-1B.Q4_0.gguf:blk.5.attn_v.weight  -  Ok
xxh3      56ed3cba9f2db119  Llama-3.2-1B.Q4_0.gguf:blk.6.attn_norm.weight  -  Ok
xxh3      084ed23415909c15  Llama-3.2-1B.Q4_0.gguf:blk.6.ffn_down.weight  -  Ok
xxh3      dfd0640bb458b38d  Llama-3.2-1B.Q4_0.gguf:blk.6.ffn_gate.weight  -  Ok
xxh3      3d7b305f0a50855b  Llama-3.2-1B.Q4_0.gguf:blk.6.ffn_up.weight  -  Ok
xxh3      b4a50fe32c657b48  Llama-3.2-1B.Q4_0.gguf:blk.6.ffn_norm.weight  -  Ok
xxh3      b8b1977d18d8d98c  Llama-3.2-1B.Q4_0.gguf:blk.6.attn_k.weight  -  Ok
xxh3      e044466a23d88c5d  Llama-3.2-1B.Q4_0.gguf:blk.6.attn_output.weight  -  Ok
xxh3      e4d01f375ac3ea46  Llama-3.2-1B.Q4_0.gguf:blk.6.attn_q.weight  -  Ok
xxh3      9de65eb5c763c707  Llama-3.2-1B.Q4_0.gguf:blk.6.attn_v.weight  -  Ok
xxh3      de7b6616336608c1  Llama-3.2-1B.Q4_0.gguf:blk.7.attn_norm.weight  -  Ok
xxh3      1d66e813fc25f089  Llama-3.2-1B.Q4_0.gguf:blk.7.ffn_down.weight  -  Ok
xxh3      0a22e3ecb2b42ccb  Llama-3.2-1B.Q4_0.gguf:blk.7.ffn_gate.weight  -  Ok
xxh3      5c250ebc0e93d5a8  Llama-3.2-1B.Q4_0.gguf:blk.7.ffn_up.weight  -  Ok
xxh3      675fbedf026a9ac7  Llama-3.2-1B.Q4_0.gguf:blk.7.ffn_norm.weight  -  Ok
xxh3      e63fa29dd76a8dfe  Llama-3.2-1B.Q4_0.gguf:blk.7.attn_k.weight  -  Ok
xxh3      b906fcdb5d72d9fb  Llama-3.2-1B.Q4_0.gguf:blk.7.attn_output.weight  -  Ok
xxh3      4e5310785ffb785c  Llama-3.2-1B.Q4_0.gguf:blk.7.attn_q.weight  -  Ok
xxh3      37bdc50f4f588d7e  Llama-3.2-1B.Q4_0.gguf:blk.7.attn_v.weight  -  Ok
xxh3      9dee0be6f7a6b4dd  Llama-3.2-1B.Q4_0.gguf:blk.8.attn_norm.weight  -  Ok
xxh3      43c1ed623dd9a9f4  Llama-3.2-1B.Q4_0.gguf:blk.8.ffn_down.weight  -  Ok
xxh3      83b43d4e4b27c887  Llama-3.2-1B.Q4_0.gguf:blk.8.ffn_gate.weight  -  Ok
xxh3      cbeeea75a76df3ea  Llama-3.2-1B.Q4_0.gguf:blk.8.ffn_up.weight  -  Ok
xxh3      2f70954e0a60c411  Llama-3.2-1B.Q4_0.gguf:blk.8.ffn_norm.weight  -  Ok
xxh3      d0bf86de2049c568  Llama-3.2-1B.Q4_0.gguf:blk.8.attn_k.weight  -  Ok
xxh3      fa94e451cb1b36ae  Llama-3.2-1B.Q4_0.gguf:blk.8.attn_output.weight  -  Ok
xxh3      006762cbacada3e0  Llama-3.2-1B.Q4_0.gguf:blk.8.attn_q.weight  -  Ok
xxh3      bd629d7ebb8d842c  Llama-3.2-1B.Q4_0.gguf:blk.8.attn_v.weight  -  Ok
xxh3      5c7bf7de912bfd4c  Llama-3.2-1B.Q4_0.gguf:blk.9.attn_norm.weight  -  Ok
xxh3      a499087924f59011  Llama-3.2-1B.Q4_0.gguf:blk.9.ffn_down.weight  -  Ok
xxh3      6467352c617ada20  Llama-3.2-1B.Q4_0.gguf:blk.9.ffn_gate.weight  -  Ok
xxh3      dc6086c67234e2f7  Llama-3.2-1B.Q4_0.gguf:blk.9.ffn_up.weight  -  Ok
xxh3      c3e43620b94dbec3  Llama-3.2-1B.Q4_0.gguf:blk.9.ffn_norm.weight  -  Ok
xxh3      b94a9c83fd1eef27  Llama-3.2-1B.Q4_0.gguf:blk.9.attn_k.weight  -  Ok
xxh3      e9e8af81d38e42e6  Llama-3.2-1B.Q4_0.gguf:blk.9.attn_output.weight  -  Ok
xxh3      a4b27341ba09ec1a  Llama-3.2-1B.Q4_0.gguf:blk.9.attn_q.weight  -  Ok
xxh3      ce050aae7a77de1e  Llama-3.2-1B.Q4_0.gguf:blk.9.attn_v.weight  -  Ok
xxh3      e71176dc493b5d59  Llama-3.2-1B.Q4_0.gguf:output_norm.weight  -  Ok
xxh3      12f464ef27cbeec5  Llama-3.2-1B.Q4_0.gguf  -  Ok

Verification results for Llama-3.2-1B.Q4_0.gguf.manifest - Success

@ixgbe
gguf-hash: add RVV tensor hashing using xxh3
32a3473 
Signed-off-by: Wang Yang <yangwang@iscas.ac.cn>
@loci-dev loci-dev mentioned this pull request Jan 4, 2026
Open
@ixgbe
Copy link
Contributor Author

ixgbe commented Jan 5, 2026

@ggerganov Could you please review this PR when you have a moment? I'd truly appreciate your insights.

@ggerganov
Copy link
Member

ggerganov commented Jan 5, 2026

You should upstream the xxhash changes first and then sync the updated version of this dependency here.

@ixgbe
Copy link
Contributor Author

ixgbe commented Jan 5, 2026 •
edited
Loading

You should upstream the xxhash changes first and then sync the updated version of this dependency here.

Thank you for your feedback. I will sync the dependency here.

@ixgbe
Copy link
Contributor Author

ixgbe commented Jan 6, 2026 •
edited
Loading

The xxHash RVV optimizations have been fully upstreamed by zijianli1234 and BoBoDai and the dependency has been manually synced to the latest version in this PR.
The merged PR link is shown below.
PR[1]: Cyan4973/xxHash#1043
PR[2]: Cyan4973/xxHash#1069
PR[3]: Cyan4973/xxHash#1070

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

examples

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@ixgbe @ggerganov