Skip to content

⚡ FastFlowLM v0.9.13 — GPT-OSS Speed Boost, Harmony Chat Template, and Ollama `/api/show` Support

Choose a tag to compare

View all tags
@FastFlowLM FastFlowLM released this 10 Oct 18:06
· 1005 commits to main since this release
v0.9.13
ad40d17
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

FastFlowLM v0.9.13 delivers performance improvements, OpenAI Harmony support, and greater compatibility with Ollama-style endpoints.

🚀 Highlights

🔹 1. GPT-OSS:20b Prefill Speed Boost

  • Up to 20% faster prefill for gpt-oss:20b
  • Reduces latency for long prompts and improves responsiveness
  • v0.9.13 auto-downloads the updated model from HuggingFace.

🔹 2. OpenAI Harmony Integration

  • Added support for OpenAI’s Harmony Chat Template
  • Enables richer multi-turn dialogue and structured generation capabilities

🔹 3. /api/show Endpoint (Ollama Compatibility)

  • FastFlowLM now supports /api/show
  • Compatible with tools that rely on Ollama API conventions

🔹 4. /v1/completions (legacy OpenAI API) is now supported

  • OpenAI do not recommend to use it for new app

⚙️ Optional Performance Tip

🆕 New NPU Driver Available
Upgrading to the latest AMD Ryzen AI NPU driver (v32.0.203.304) may boost prefill and decoding performance by an additional 5–10%.
📄 Download Link

Note: You will need an AMD account to access the driver.

This release makes FastFlowLM faster, more OpenAI-compatible, and ready for broader integration into multimodal workflows and edge deployments.

Assets 3
Loading