Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

122 Open 740 Closed
122 Open 740 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] 使用LM启动API服务器的InternVL-1.5无法识别图片
#1701 opened Jun 1, 2024 by BigWhiteFox
1 of 2 tasks
How is the support for RoPE difference between hf llama and meta llama?
#1700 opened May 31, 2024 by sleepwalker2017
@lzhangzz
[Bug] ModuleNotFoundError: No module named '_turbomind' loading llava Mistral 7B
#1699 opened May 31, 2024 by Alexis-IMBERT
2 tasks done
@lvhan028
1
[Bug] not support inference qwen1.5
#1697 opened May 31, 2024 by zzc0208
2 tasks done
@lvhan028
4
InternVL模型在推理时是否可以控制max_tiles参数等或者是否可以pipline直接传入pixel_values
#1696 opened May 31, 2024 by YuMingtao0503
@irexyc
3
[Feature] support for MiniCPM-Llama3-V 2.5
#1693 opened May 31, 2024 by LRHstudy
@irexyc
1
[Feature] InternVL-Chat-V1-5-AWQ merge LoRA adapter awaiting response
#1691 opened May 30, 2024 by isongxw
@AllentDan
3
batch inference
#1689 opened May 30, 2024 by dirtycomputer
@lvhan028
1
[Bug] output diff when temperature set zero
#1688 opened May 30, 2024 by zhyncs
2 tasks done
@irexyc
3
[Docs] How are multiple images handled?
#1686 opened May 30, 2024 by pseudotensor
@irexyc
5
[Feature] Support for LLaVA-NeXT
#1685 opened May 29, 2024 by deece
@irexyc
总是看到一个using default GEMM algo的WARNING，是否会因为使用了默认的GEMM而影响速度或者吞吐量？
#1680 opened May 29, 2024 by lzcchl
@lzhangzz
Support for SWIFT finetuned models
#1678 opened May 29, 2024 by babla9
@lvhan028
2
[Bug] result of W4A16 quantized Qwen1.5-1.8B-Chat model not correct
#1676 opened May 29, 2024 by dawnranger
2 tasks done
@lvhan028
1
[Bug] lmdeploy lite auto_awq: RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0!
#1675 opened May 29, 2024 by dawnranger
2 tasks done
@AllentDan
1
[Feature] health endpoint
#1673 opened May 28, 2024 by pseudotensor
@AllentDan
2
[Feature] AWQ量化的校准数据集
#1671 opened May 28, 2024 by GZL11
[feature] need rope_scaling_factor args in benchmark/profile_generation.py to enable dynamic NTK.
#1670 opened May 28, 2024 by zhulinJulia24
2 tasks
@zhulinJulia24
请问 TurboMind 支持cogvlm系列么？ awaiting response
#1668 opened May 28, 2024 by samaritan1998
@RunningLeon
1
[Bug] WSL2环境下，0.4.2做InternVL量化时，磁盘写入速度极低 awaiting response
#1667 opened May 28, 2024 by ysyx2008
2 tasks
@AllentDan
6
Batch infer seems no speed up awaiting response
#1665 opened May 28, 2024 by xiangqi1997
1 of 2 tasks
@irexyc
8
[Bug] w4a16量化Qwen1.5-chat模型报错 awaiting response
#1656 opened May 27, 2024 by legends-7
2 tasks done
@AllentDan
2
换用 LLM 基座的 LLaVA 模型适配 good first issue Good for newcomers
#1655 opened May 24, 2024 by red-fox-yj
@irexyc
1
[Feature] A series of various optimization points
#1647 opened May 23, 2024 by zhyncs
@lvhan028
6
LMDeploy-0.4.1运行qwen1.5 110B，推理长时间无结果 awaiting response
#1639 opened May 22, 2024 by summerrain321
2 tasks done
@irexyc
1
ProTip! Find all open issues with in progress development work with linked:pr.