Search results

Confusion in Selecting Indices

Status: Open.

#31 In FasterDecoding/SnapKV;

· Lueci4er opened on Apr 25, 2025

About Needle in a Haystack test

Status: Open.

#30 In FasterDecoding/SnapKV;

· YUECHE77 opened on Apr 7, 2025

Repeated k/v eliminates GQA advantage and full attention in the prefill stage

Status: Open.

#29 In FasterDecoding/SnapKV;

· Ppaddington opened on Mar 21, 2025

Bug on Qwen2-VL

Status: Open.

#28 In FasterDecoding/SnapKV;

· LiJunscs opened on Jan 10, 2025

The first generation token output sees the whole cache key and value

Status: Open.

#27 In FasterDecoding/SnapKV;

· PengWenChen opened on Jan 6, 2025

Question: is key_state_compressed used for inference?

Status: Open.

#24 In FasterDecoding/SnapKV;

· jq-wei opened on Nov 20, 2024

What happens to the total KV length > max-compacity length during response generation?

Status: Open.

#23 In FasterDecoding/SnapKV;

· PengWenChen opened on Oct 23, 2024

Group Query Attention

Status: Open.

#22 In FasterDecoding/SnapKV;

· SimJeg opened on Oct 3, 2024

Question on H2O experiment reproduction

Status: Open.

#21 In FasterDecoding/SnapKV;

· CUHKSZzxy opened on Aug 8, 2024

Could you provide the code for visualization the Hit Rate?

Status: Open.

#19 In FasterDecoding/SnapKV;

· Dominic789654 opened on Jul 1, 2024

Can snapkv compress kv in case different user questions are posed towards the same context?

Status: Open.

#18 In FasterDecoding/SnapKV;

· namespace-Pt opened on Jun 27, 2024

Question on GQA implementation

Status: Open.

#16 In FasterDecoding/SnapKV;

· cyLi-Tiger opened on Jun 17, 2024