🚀 FastFlowLM v0.9.41 - Tool Calling + Usability Updates

🐛 Bug Fixes

🛠️ Tool Calling Cache Redundancy

Fixed an issue where tool schemas could be injected into the KV cache on every cached turn.

This could fill the model context window with repeated copies of the same schema, wasting context tokens, increasing compute time, and making tool-calling behavior less reliable as instructions appeared repeatedly mid-conversation.

Thanks to nvolcz from Discord for reporting this issue!

---

✨ Improvements

📊 Chat Completions Logging

OpenAI-compatible chat completions logging now reports KV cache usage for each conversation round.

Example fields include:

{
    "active_kv_tokens": 4096,
    "max_kv_token_capacity": 32768,
    "kv_token_occupancy_percentage": 12.5
}

kv_token_occupancy_percentage = 4096 / 32768 × 100% = 12.5%

🎧 Gemma4 Audio Logging

Improved Gemma4 audio logging to make long-audio handling easier to understand.

The previous wording could suggest that audio was clipped or partially dropped. The updated message now makes it clear when audio has been split into chunks for processing.

Example:

Audio in message is split into 33 chunks for processing.

Thanks to @gdkrmr for the suggestion.

🐧 Arch Linux Guide

Added an Arch Linux installation guide to the documentation.

For installation instructions, see the Arch Linux guide.

Thanks to @filipenf for the contribution!

🔕 Version Check Control

FastFlowLM can now disable the automatic version check before run and serve modes.

To disable the startup version check, set system environment variable FLM_DISABLE_UPDATE_CHECK to 1:

Linux:

export FLM_DISABLE_UPDATE_CHECK=1

Windows:

setx FLM_DISABLE_UPDATE_CHECK 1

Thanks to @heliosran for the contribution.

🧰 Linux make install

Improved Linux installation behavior by avoiding accidental third-party submodule installs and placing bundled FLM shared libraries under ${CMAKE_INSTALL_LIBDIR}/flm.

Thanks to @J-Bu for the contribution.

---

🌟 Summary

FastFlowLM v0.9.41 fixes redundant tool schema injection in cached conversations and adds clearer observability for KV cache usage and Gemma4 audio processing. This release also improves Linux installation workflows with a new Arch Linux guide, better make install behavior, and an option to disable automatic version checks.