fp4

Here are 4 public repositories matching this topic...

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

An innovative library for efficient LLM inference via low-bit quantization

Slow, low-precision floating point types

floating-point minifloat microfloat fp6 fp8 fp4 microscaling

fairphone lito fp4

Add a description, image, and links to the fp4 topic page so that developers can more easily learn about it.

To associate your repository with the fp4 topic, visit your repo's landing page and select "manage topics."