Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 29
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

365 Open 607 Closed
365 Open 607 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

System role not supported Gemma 2
#1580 opened Jul 7, 2024 by rzafiamy
2 tasks
2
The installation described in README.md does not enable hipBLAS.
#1579 opened Jul 7, 2024 by kfule
Illegal instruction (core dumped) when using llama_cpp_python-0.2.81 with text-generation-webui
#1578 opened Jul 6, 2024 by 9600-
4 tasks done
1
Llama 3 8b Instruct giving garbage response
#1577 opened Jul 6, 2024 by gformcreation
The new shared library causes conflicts if more than 1 variant of llama-cpp-python is imported
#1575 opened Jul 5, 2024 by oobabooga
6
build error for version 0.2.81 and 0.2.80
#1573 opened Jul 5, 2024 by charliboy
2
BUG: import error or execute error (NULL pointer access) for the latest prebuilt version v0.2.81
#1571 opened Jul 3, 2024 by ChengjieLi28
1
Please provide CU118 wheels in future
#1570 opened Jul 3, 2024 by i486
1
MISTRAL_INSTRUCT_BOS_TOKEN is not used in the format_mistral_instruct()
#1566 opened Jul 2, 2024 by sbelenki
Pyinstaller Cannot Find File After Compiling
#1565 opened Jun 30, 2024 by SavorSauc3
Add MiniCPM-Llama3-V-2_5 to supported multi-modal models
#1564 opened Jun 30, 2024 by Kkordik
Switch to disable adding BOS token
#1561 opened Jun 28, 2024 by etemiz
1
tool_call function "name" has incorrect format so function calling does not work for functionary
#1560 opened Jun 28, 2024 by eli6
4 tasks done
"llama.cpp error: 'error loading model architecture: unknown model architecture: 'deepseek2'
#1556 opened Jun 26, 2024 by ZeroCool22
3 of 4 tasks
6
Not sure if it's a bug or a configuration error...
#1555 opened Jun 26, 2024 by 0wwafa
Hope to add support for GLM4-9b.
#1554 opened Jun 26, 2024 by Axiaozhu1
[Question]Does llama-cpp-python support concurrent multiple requests
#1549 opened Jun 24, 2024 by lzy248
4
Grammars bracket repetition symbol not working
#1547 opened Jun 22, 2024 by Viagounet
5
How to log raw token generation? enhancement New feature or request
#1546 opened Jun 21, 2024 by sisi399
Not Able To Utilize AMD GPU's bug Something isn't working
#1545 opened Jun 21, 2024 by Essak786
1
Qwen-7B-Instruct Model numpy.core._exceptions._ArrayMemoryError: bug Something isn't working
#1542 opened Jun 18, 2024 by khoinpd0411
3
Recurrent errors in server mode bug Something isn't working
#1541 opened Jun 18, 2024 by mhoangvslev
1
I want to use pandas profiling but this error is thrown by my system
#1540 opened Jun 18, 2024 by code84
Cannot build wheel
#1538 opened Jun 17, 2024 by LankyPoet
4
Llama3 instruct prompt template missing BOS token
#1537 opened Jun 17, 2024 by pmbaumgartner
4 tasks done
6
ProTip! What’s not been updated in a month: updated:<2024-06-08.