Search results

could it support Qwen?

Status: Open.

#19 In SqueezeAILab/KVQuant;

· Heccc257 opened on Feb 6, 2025

could it support LLAMA-3.1-8B-INSTRUCT?

Status: Open.

#18 In SqueezeAILab/KVQuant;

· LiMa-cas opened on Dec 19, 2024

Evaluating KVQuant for 128k sequence length

Status: Open.

#17 In SqueezeAILab/KVQuant;

· md-hassan opened on Nov 24, 2024

why are the fp16 baseline perplexity values little different?

Status: Open.

#16 In SqueezeAILab/KVQuant;

· shahaamirbader opened on Oct 2, 2024

Problems when reproducing the method on Qwen2-7b-instruct

Status: Open.

#15 In SqueezeAILab/KVQuant;

· jiangshimiao opened on Sep 14, 2024

How to reproduce the table 19 (kvquant vs kivi)

Status: Open.

#14 In SqueezeAILab/KVQuant;

· condy0919 opened on Aug 21, 2024

Coupled Channel-wise Quantization

Status: Open.

#12 In SqueezeAILab/KVQuant;

· naston opened on Jun 30, 2024

Would the current implementation of Fisher Information work out of the box with Multi-head Latent Attention

Status: Open.

#11 In SqueezeAILab/KVQuant;

· naston opened on Jun 30, 2024

[Question] How to run HF model with 1m-length tokens in your exp?

Status: Open.

#10 In SqueezeAILab/KVQuant;

· 1649759610 opened on May 17, 2024

CUDA error: an illegal memory access was encountered

Status: Open.

#9 In SqueezeAILab/KVQuant;

· CUHKSZzxy opened on May 5, 2024

Question about storage

Status: Open.

#8 In SqueezeAILab/KVQuant;

· mlxht990720 opened on May 5, 2024

Where is the code of "ATOM-4bit"in the KVQuant codebase?

Status: Open.

#7 In SqueezeAILab/KVQuant;

· leoliu1979 opened on Apr 17, 2024