Skip to content

v0.9.1

@birdnamoo birdnamoo tagged this 18 Dec 07:57
- Upgrade FluxCurator 0.5.0 → 0.6.4 with token optimization features
- Apply minimum-config principle: quality features enabled by default
- Change default TextRefinementPreset from "Light" to "Standard"
- Add new presets: ForTokenOptimization, ForAggressiveTokenOptimization
- Update ForRAG preset to use ForTokenOptimization
- Add preset mappings in DocumentProcessor

Token optimization includes:
- Repeated character normalization (====...==== → ====)
- Decorative separator standardization
- ASCII art removal (optional)
- Base64 data removal (optional)

Expected token reduction: 15-45% depending on document type
Assets 2
Loading