Repository navigation
v1.4.0
What's New 🚀
🧠 Dynamic LLM Loading (RAM-Aware)
WaveRedact now automatically detects your system's available memory before initializing the Validation LLM, ensuring maximum stability without crashing on lower-end hardware:
- For systems with <= 8 GB of available RAM: The pipeline now automatically falls back to Gemma-3-4b (
Q5_K_XL). This lighter model (~2.64 GB) provides an excellent balance of performance and stability on constrained systems. - For systems with > 8 GB of available RAM: The pipeline loads our optimal Qwen2.5-7B-Instruct model for the highest quality PII validation.
⚡ Validation Model Optimizations
To further optimize memory usage and processing speed, the primary validation model has been slightly adjusted:
- Switched the Qwen2.5-7B quantization from Q5_K_M to Q4_K_M. This reduces the memory footprint to ~4.3 GB while maintaining nearly identical redaction quality and reasoning capabilities.