Pinned Loading

1. vllm-kvcompress vllm-kvcompress Public

   KV cache compression for high-throughput LLM inference

   Python 78 4

2. tacklebox tacklebox Public

   Improved handling of PyTorch module hooks

   Python 7

3. Syntactically-Constrained-Sampling Syntactically-Constrained-Sampling Public

   LLM sampling method for enforcing syntax adherence in generated output

   Jupyter Notebook 21 1

4. animation-assist-data animation-assist-data Public

   Simple application for downloading and labeling Flickr images with deployment to GCP

   Jupyter Notebook