Skip to content

Issues: mlc-ai/mlc-llm

Project Tracking
#647 opened Aug 2, 2023 by tqchen
Open
Model Request Tracking
#1042 opened Oct 9, 2023 by CharlieFRuan
Open 4
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

126 Open 1,012 Closed
126 Open 1,012 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Question] Is there a way to compute ppl of models in MLC-LLM? question Question about the usage
#2554 opened Jun 8, 2024 by ponytaill
Qwen2-72B-Instruct MultiGPU 8xP100 bug Confirmed bugs
#2549 opened Jun 7, 2024 by alphaarea
2
[Bug] Could NOT find Doxygen (missing: DOXYGEN_EXECUTABLE) bug Confirmed bugs
#2541 opened Jun 7, 2024 by panghongtao
2
[Bug] Apple Metal/MPS -- TVM/MLC-LLM won't compile from source bug Confirmed bugs
#2540 opened Jun 7, 2024 by BuildBackBuehler
5
[Question] Unable to download and compile custom model from Hugging Face using mlc_llm package command question Question about the usage
#2525 opened Jun 6, 2024 by AbhayGopal
5
QWen1.8b acuracy in noquantize bug Confirmed bugs
#2522 opened Jun 6, 2024 by chenzhenbupt
11
[Bug] chatglm4 mlc_llm shows error "TVMError: Check failed: append_length > 0 (0 vs. 0) : Append with length 0 is not allowed." during mlc_llm chat CLI bug Confirmed bugs
#2517 opened Jun 6, 2024 by lihaofd
5
[Question] Running mlc_llm into a multi-phase container build question Question about the usage
#2512 opened Jun 5, 2024 by oglok
10
[Bug] FlashInfer decode BeginForward error an illegal instruction was encountered bug Confirmed bugs
#2509 opened Jun 4, 2024 by zifeitong
@yzh119
1
[Feature Request] please allow f32q5_k and f16q5_k quantizations feature request New feature or request
#2506 opened Jun 4, 2024 by 0wwafa
[Bug] mlc_llm serve throws CUDA: invalid device ordinal bug Confirmed bugs
#2498 opened Jun 3, 2024 by josephrocca
4
[Question] Cannot compile custom model to work on web browser question Question about the usage
#2485 opened Jun 2, 2024 by lawofcycles
[Model Request] T5 new-models
#2483 opened May 31, 2024 by starlight70
[Doc] benchmark on different hardware documentation Improvements or additions to documentation
#2475 opened May 30, 2024 by louis030195
[Doc] Request for suggested build-from-source options + explanation of added functionality documentation Improvements or additions to documentation
#2473 opened May 30, 2024 by BuildBackBuehler
1
Compiling WebAssembly library with debug symbols/source map to aid in debugging question Question about the usage
#2472 opened May 30, 2024 by slash-under
mlc_llm serve fails on concurrent users - Llama3 70B parameter hosting bug Confirmed bugs
#2462 opened May 29, 2024 by swamysrivathsan
4
'ChatGLMTokenizer' object has no attribute 'backend_tokenizer' bug Confirmed bugs
#2460 opened May 29, 2024 by lihaofd
2
[Doc] Python API KV/memory reset details absent documentation Improvements or additions to documentation
#2426 opened May 26, 2024 by federicoparra
6
[Feature Request] phi-3 small realeased -> performs two times ebtter then Phi-3 mini feature request New feature or request
#2420 opened May 26, 2024 by sebastienbo
1
Phi-2 q4f16_1 runs faster when compiled without tvm.relax.transform.FuseOps() and tvm.relax.transform.FuseTIR() transformations bug Confirmed bugs
#2405 opened May 24, 2024 by MMuzzammil1
4
Fail to build tvm-unity from source on orin[Bug] bug Confirmed bugs
#2389 opened May 23, 2024 by Louym
2
[Model Request] Phi-3-Vision new-models
#2388 opened May 23, 2024 by NSTiwari
4
[Question] Single forward pass through ChatModule question Question about the usage
#2354 opened May 17, 2024 by caenopy
2
[Feature Request] Implement AttentionStore feature request New feature or request
#2353 opened May 16, 2024 by kripper
ProTip! Add no:assignee to see everything that’s not assigned.