Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document how to build ctranslate2 with zenddn #1

Open
commandline-be opened this issue Jan 23, 2024 · 0 comments
Open

Document how to build ctranslate2 with zenddn #1

commandline-be opened this issue Jan 23, 2024 · 0 comments

Comments

@commandline-be
Copy link

馃殌 The feature, motivation and pitch

Having an on-site translation engine is both practical and privacy friendly to that end I sought to have a GPU accelerated translator.

Attempting to run argostanslate which builds on ctranslate2 I ended up with what seems like a dead end for an AMD GPU (Radeon VII) Digging a bit deeper I found agrostranslate > opennmt > ctranslate2 (supports CUDA 100% not AMD 100%) < onednn (supports AMD)

For reference

OpenNMT/CTranslate2#1072
ROCm/ROCm#2534

I'd appreciate your informed feedback.

Alternatives

alternatives considered and tried
use rocm 6.x

Additional context

Because I lack the background to progress thru trial and error on this matter I'd like to understand what is possible with ZenDNN/ZenDNN-pytorch to recompile and maybe counter any compatibility challenges

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant