Running EmbeddingGemma ONNX with Hugot #127
kepae
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Enjoyed running the (quantized) ONNX port of EmbeddingGemma with Hugot today!
Gist here: https://gist.github.com/kepae/94eb287b8829327ca9b39ea3d3e03907
A few observations:
DownloadOptions.ExternalDataPathis needed to load the weights for this model (and others depending on packaging). That wasn't clear to me at first, I might try to update some docs/code doc with that or an example.context, which means updating the docs a bitBeta Was this translation helpful? Give feedback.
All reactions