Skip to content

rednote-machine-learning/RedKnot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 

Repository files navigation

RedKnot

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

About

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors