Skip to content

🚀 FastFlowLM v0.9.17 — Faster Vision Understanding for Qwen3VL, Improved Memory Management for GPT-OSS, and New OpenAI Safeguard Model

Choose a tag to compare

View all tags
@FastFlowLM FastFlowLM released this 06 Nov 14:49
· 1116 commits to main since this release
v0.9.17
7bac50f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

FastFlowLM v0.9.17 brings performance boosts to vision models, improves compatibility for systems with limited RAM, and adds a safer GPT-OSS variant.

✨ What’s New

⚡ 1. Faster Vision Understanding for Qwen3VL

  • Speedup for image embedding with Qwen3VL models.
  • Require redownloading the model

🧠 2. GPT-OSS Optimization for Low-RAM Machines

  • Improved memory management for gpt-oss:20b. Increase the chance to run on 32GB system (note: NPU can access <50% of total RAM).
  • Speedup for decoding at long context lengths.
  • Driver version higher than 32.0.203.304 is required
  • Require redownloading the model

🛡️ 3. New Model: gpt-oss-safeguard:20b

  • A safety-enhanced, instruction (prompt)-tuned variant of gpt-oss:20b.
  • Optimized for assistant-style tasks with safer responses.
  • Run with: 
    flm run gpt-oss-sg:20b

⚠️ 4. API Focus: OpenAI-Compatible

  • Discontinuing Ollama API support.
  • Focusing on the OpenAI-compatible API.

This release enhances speed and system flexibility, while expanding FastFlowLM’s model lineup with secure, large-scale assistants.

Assets 3
Loading