Repository navigation
KVarN: 3-5x more context, throughput above FP16, and FP16-level accuracy. from Huawei is used to back their Qwen workload. would be nice to add here #1290
nikolaydubina
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
https://github.com/huawei-csl/KVarN
All reactions