New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(cuda): pass pointer instead of copy-by-value in llama_sample_token #228

Merged

mudler merged 1 commit into master from fix_gpu_prediction

Sep 21, 2023

Member

mudler commented Sep 21, 2023

Follow up of #218


          fix(cuda): pass pointer instead of copy-by-value in llama_sample_token

1c7a0de

Signed-off-by: mudler <mudler@localai.io>

mudler mentioned this pull request

how to resolve this error? trying to run cublas #218

Closed

mudler merged commit 621a001 into master

6 checks passed

mudler deleted the fix_gpu_prediction branch

September 21, 2023 15:46

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet