Skip to content

FGRF Initial Release - LLM Optimization Framework

Choose a tag to compare

@RicPini RicPini released this 06 Sep 11:47
· 6 commits to main since this release

Fractal Graph Rewriting Framework (FGRF) v1.0

This is the initial public release of the FGRF framework for optimizing LLMs without retraining.

Key Features:

Single-pass weight transformation for LLMs
Works on CPU with 8-14GB RAM
Tested on models up to 1.1B parameters

Results:

Qwen2.5-0.5B: 99.08 → 12.57 PPL (−87.3%)
TinyLlama-1.1B: 64.72 → 28.07 PPL (−56.6%)
GPT-2: 141.65 → 132.99 PPL (−6.1%)

For more details, see the paper in the paper/ folder.