Skip to content

Pull requests: InternLM/lmdeploy

New pull request New
30 Open 920 Closed
30 Open 920 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Remove kv cache offline quantization
#2097 opened Jul 22, 2024 by AllentDan Loading…
1
New GEMM kernels for weight-only quantization WIP
#2090 opened Jul 19, 2024 by lzhangzz Loading…
Add nest_asyncio to requirements
#2085 opened Jul 19, 2024 by AllentDan Loading…
Add slora serving document documentation Improvements or additions to documentation
#2084 opened Jul 19, 2024 by AllentDan Loading…
raise thread exception Bug:P1
#2071 opened Jul 18, 2024 by irexyc Loading…
1
InternLM Summer Camp3
#2059 opened Jul 17, 2024 by boshallen Loading…
3
Support custom attention backend
#2046 opened Jul 16, 2024 by grimoire • Draft
Reorganize the user guide documentation Improvements or additions to documentation WIP
#2038 opened Jul 16, 2024 by lvhan028 Loading…
1 of 3 tasks
Add log info for prefix cache
#2018 opened Jul 13, 2024 by ispobock Loading…
15
Phi3 awq
#1984 opened Jul 10, 2024 by grimoire Loading…
1 task
support min_p sampling & do_sample setting WIP
#1966 opened Jul 9, 2024 by irexyc Loading…
4
torch engine optimize prefill for long context improvement
#1962 opened Jul 9, 2024 by grimoire Loading…
3
Remove deprecated arguments from API and clarify model_name and chat_template_name BC-breaking improvement WIP
#1931 opened Jul 5, 2024 by lvhan028 Loading…
PyTorch Engine AWQ support enhancement New feature or request
#1913 opened Jul 3, 2024 by grimoire Loading…
18
Fix index error when profiling token generation with -ct 1 Bug:P1
#1898 opened Jul 2, 2024 by lvhan028 Loading…
2
Support guided decoding for pytorch backend enhancement New feature or request
#1856 opened Jun 26, 2024 by AllentDan Loading…
13
feat: decouple input_ids and output_ids
#1855 opened Jun 25, 2024 by zhyncs Loading…
1
Maybe a workaround for qwen2 quantization Nan error
#1844 opened Jun 25, 2024 by AllentDan • Draft
5
Add Jetson platform support (by docker)
#1820 opened Jun 21, 2024 by BestAnHongjun Loading…
feat: skip invokeFlattenKV_v2_ when fp16 and bf16 with CacheType::kBlock
#1683 opened May 29, 2024 by zhyncs Loading…
5
support vl benchmark
#1662 opened May 27, 2024 by AllentDan Loading…
12
Check base64 image validation Bug:P2
#1615 opened May 20, 2024 by AllentDan Loading…
13
[benchmark] optimize benchmark: counting tokenlizer tokens and error requests
#1607 opened May 17, 2024 by NiuBlibing Loading…
5
support AI4Chem/ChemLLM-7B-Chat-1_5-SFT WIP
#1552 opened May 7, 2024 by lvhan028 Loading…
fix: update api_server_backend.py to adapt latest gradio improvement
#1541 opened May 3, 2024 by kv-chiu Loading…
6
ProTip! Adding no:label will show everything without a label.