Skip to content

v0.27.1 - Neural Engine packages you can download

Choose a tag to compare

@srvsngh99 srvsngh99 released this 22 Oct 05:50
· 19 commits to main since this release
e357db7

Neural Engine packages are now published and downloadable with krill pull. krill pull bge-base-en-ane-fp16 replaces building it yourself (all supported embedders as <model>-ane-fp16, bge-reranker-base-ane-lin8, embeddinggemma-2-ane-lin8). Pull the normal model too, then set embed_device = "ane". make ane-package still works. See docs/ANE_EMBEDDER.md.