Skip to content

🔧 FastFlowLM v0.1.2 — New API Support and Stability Improvements

Pre-release
Pre-release

Choose a tag to compare

View all tags
@FastFlowLM FastFlowLM released this 29 Jun 22:56
· 1485 commits to main since this release
v0.1.2
6da814f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

🔧 FastFlowLM v0.1.2 — API Support and Stability Improvements

We’re pleased to announce v0.1.2 of FastFlowLM, focused on extending API compatibility and improving output stability in server mode.

✨ What's New

  1. Initial Support for OpenAI-Compatible API

    • Added basic support for the /v1/api/completions endpoint.
      This opens the door for broader integration with OpenAI-compatible tools and clients.

  2. Unicode Streaming Fix

    • Resolved a critical bug where Unicode characters could break the output stream in serve mode.

  3. Minor Cleanup

    • Fixed several typos across logs, prompts, and documentation.

✅ Reminder: Usage Examples

Interactive Mode:

flm run llama3.2:1B

Server Mode (default model is llama3.2:1B):

flm serve

Now supports /v1/api/completions in addition to native REST format.

Assets 3
Loading