Repository navigation
TranslateGemma 4B for live, two-way Discord translation #828
ManveerAnand
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I built BOLBOT, an open-source Discord bot that translates every message into each member's language using TranslateGemma 4B running locally (oMLX on a Mac, Ollama on Windows).
What I found:
/api/generatewithraw: true:/v1/completionsapplies the chat template a second time and garbles a prompt that's already templated.Repo: https://github.com/ManveerAnand/BOLBOT
Thanks for releasing TranslateGemma openly.
All reactions