Repository navigation
🚀 FastFlowLM v0.9.18 — Major Prefill Boost for GPT-OSS & Full LFM2 Integration
✨ What’s New
🔥 1. Significant Prefill Acceleration for GPT-OSS Models
FastFlowLM’s execution pipeline has undergone deep optimization, resulting in significant improvements to prefill performance — including faster time to first token (TTFT) and more efficient long-context ingestion.
Currently, these enhancements apply to:
- gpt-oss:20b
- gpt-oss-safeguard:20b
⬇️ A model redownload is required.
đź’§ 2. Full Support for LFM2-1.2B (Liquid Foundation Model)
FastFlowLM now supports the LFM2-1.2B model (LiquidAI): first hybrid LLM architecture on AMD AMD Ryzen AI NPU, powered by very efficient FLM's linear attention engine.
Try it:
- CLI mode
flm run lfm2:1.2b- Serve mode
flm serve lfm2:1.2bThis release delivers a major prefill speed boost for GPT-OSS models and introduces full support for the LFM2-1.2B Liquid Foundation Model.