Skip to content

Issues: mlc-ai/mlc-llm

Project Tracking
#647 opened Aug 2, 2023 by tqchen
Open
Model Request Tracking
#1042 opened Oct 9, 2023 by CharlieFRuan
Open 4
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

233 Open 1,262 Closed
233 Open 1,262 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] Binary was created using {relax.Executable} but a loader of that name is not registered. Available loaders are relax.VMExecutable, const_loader, static_library, metal. Perhaps you need to recompile with this runtime enabled. bug Confirmed bugs
#3186 opened Mar 21, 2025 by Japp-Galang
[Bug] TVMError: Check failed: (!support_sliding_window_) is false: Kernel BeginForward doesn't support sliding window bug Confirmed bugs
#3184 opened Mar 19, 2025 by FFchopon
[Bug] The response often gets trapped in an infinite loop error when running models using mlc-llm bug Confirmed bugs
#3183 opened Mar 19, 2025 by FFchopon
[Bug] gemma3 WebGPU <unnamed> panicked bug Confirmed bugs
#3182 opened Mar 18, 2025 by nico-martin
mlc_llm package error[Bug] bug Confirmed bugs
#3180 opened Mar 18, 2025 by liguiyuan
8
[Bug] llama3: same text tokenize to different token cause prefix cache match fail. bug Confirmed bugs
#3179 opened Mar 17, 2025 by sunzj
2
[Bug] clang linker error upon running any model in Windows bug Confirmed bugs
#3177 opened Mar 16, 2025 by TheOtherGuy
[Question] Does it support multi-gpu (intel ARC A770)? question Question about the usage
#3175 opened Mar 14, 2025 by savvadesogle
1
A significant difference in answer quality between the model provided by the official and the model obtained by converting weights based on official documents question Question about the usage
#3174 opened Mar 14, 2025 by FFchopon
2
[Bug] The Medusa model has some differences from the current official implementation bug Confirmed bugs
#3173 opened Mar 14, 2025 by Songyanfei
[Question] How to get last layer hidden state of transformer model while transfer the model to MLC format? question Question about the usage
#3170 opened Mar 11, 2025 by Jianshu1only
1
[Bug] App closes itself when initializing a model, DeepSeek-R1-Distill-Qwen-1.5B-q4f16_1-MLC bug Confirmed bugs
#3169 opened Mar 11, 2025 by GTMssj
[Question] VLM inference on android question Question about the usage
#3167 opened Mar 10, 2025 by amirvenus
[Bug] Issues with MLC on ROCM bug Confirmed bugs
#3156 opened Mar 8, 2025 by KartDriver
[Model Request] phi-4-mini-instruct new-models
#3146 opened Feb 27, 2025 by j0h0k0i0m
[Bug] Mlc cli server gets stuck bug Confirmed bugs
#3145 opened Feb 26, 2025 by falkbene
Question about flashinfer constraints
#3144 opened Feb 25, 2025 by mayakolad
[Question] mlc-llm server cannot return correct logprobs question Question about the usage
#3142 opened Feb 19, 2025 by kunxiongzhu
12
[Question] how to use function call question Question about the usage
#3141 opened Feb 19, 2025 by tebie6
[Model Request] GLINER for entity recognisition new-models
#3139 opened Feb 17, 2025 by manasaniprashanth
[Bug] Gemma 2 models fail due to errors in tokenizer bug Confirmed bugs
#3138 opened Feb 17, 2025 by julioasotodv
[Question] I followed the instructions to build for Orange Pi, but it seems outdated (ChatModule) question Question about the usage
#3134 opened Feb 16, 2025 by LivingLinux
[Question] While waiting for the model's response on an Android phone, performing other operations may cause the phone to become unresponsive or reboot. question Question about the usage
#3131 opened Feb 13, 2025 by yangshgetui
2
[Bug] Is it compiling? CUDA 12.8 bug Confirmed bugs
#3129 opened Feb 12, 2025 by johnnynunez
[Bug] Mistral-Nemo-Instruct-2407 The results were confused bug Confirmed bugs
#3120 opened Feb 7, 2025 by fierceX
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.