Files

quantization

and

Support fp8 w8a8 for pt backend (InternLM#2959 )

Jan 3, 2025

bc86b94 · Jan 3, 2025

This branch is 1 commit behind InternLM/lmdeploy:main.

Name		Name	Last commit message	Last commit date
parent directory ..
kv_quant.md		kv_quant.md	Reorganize the user guide and update the get_started section (InternL…	Aug 7, 2024
w4a16.md		w4a16.md	Support torch_dtype modification and update FAQs for AWQ quantization (…	Dec 25, 2024
w8a8.md		w8a8.md	Support fp8 w8a8 for pt backend (InternLM#2959 )	Jan 3, 2025