Skip to content

🚀 FastFlowLM v0.9.18 — Major Prefill Boost for GPT-OSS & Full LFM2 Integration

Choose a tag to compare

@FastFlowLM FastFlowLM released this 13 Nov 17:45
· 1276 commits to main since this release
15292b0

✨ What’s New

🔥 1. Significant Prefill Acceleration for GPT-OSS Models

FastFlowLM’s execution pipeline has undergone deep optimization, resulting in significant improvements to prefill performance — including faster time to first token (TTFT) and more efficient long-context ingestion.

Currently, these enhancements apply to:

  • gpt-oss:20b
  • gpt-oss-safeguard:20b

⬇️ A model redownload is required.


đź’§ 2. Full Support for LFM2-1.2B (Liquid Foundation Model)

FastFlowLM now supports the LFM2-1.2B model (LiquidAI): first hybrid LLM architecture on AMD AMD Ryzen AI NPU, powered by very efficient FLM's linear attention engine.

Try it:

  1. CLI mode
flm run lfm2:1.2b
  1. Serve mode
flm serve lfm2:1.2b

This release delivers a major prefill speed boost for GPT-OSS models and introduces full support for the LFM2-1.2B Liquid Foundation Model.