New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: avoid llama.cpp's racing #923

Merged

wsxiaoys merged 1 commit into main from fix-llama-cpp-racing

Nov 30, 2023

Member

wsxiaoys commented Nov 30, 2023 •

edited

According to the information available at ggerganov/llama.cpp#3960, the issue appears to exclusively impact CUDA, aligning with our observations.

Nevertheless, we are implementing a mutex for all backends regardless.


          fix: avoid llama.cpp's racing

09918b8

wsxiaoys force-pushed the fix-llama-cpp-racing branch from 8f3a671 to 09918b8 Compare

November 30, 2023 14:20

wsxiaoys merged commit ffd5ef3 into main

5 checks passed

wsxiaoys deleted the fix-llama-cpp-racing branch

November 30, 2023 15:52

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment