Skip to content

Releases: poisonxa16/pxq-quantize

pxq-quantize v2026.09.20

Choose a tag to compare

@poisonxa16 poisonxa16 released this 21 Sep 21:04

The PXQ encoder for pxa v2026.09.20 (https://github.com/poisonxa16/pxa/releases/tag/v2026.09.20). CPU only, Linux x86_64.

sha256 766c83f4b9721990ed1e8b0615a25e3267c3297ecaff33b66b96a63ff02a7c07

tar xzf pxq-quantize-v2026.09.20-linux-x86_64.tar.gz
cd pxq-quantize-v2026.09.20
./pxq-quantize model-f16.gguf model-PXQ4.gguf PXQ4

The default search writes the same files as before, byte for byte. New in this build: an optional importance matrix (PXA_PXQ_IMX=1 with --imatrix, collected on chat-formatted text) gives a closer file at the same size - see the README and tutorial 04 in the engine docs.