Skip to content

🚀 FastFlowLM v0.1.3 — Metadata, File Prompts, and Code Readiness

Pre-release
Pre-release

Choose a tag to compare

View all tags
@FastFlowLM FastFlowLM released this 02 Jul 20:01
· 1510 commits to main since this release
v0.1.3
d85ec54
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

🚀 FastFlowLM v0.1.3 — Metadata, File Prompts, and Code Readiness

FastFlowLM v0.1.3 brings important improvements for usability, WebUI integration, and future extensibility.

✨ What's New

  1. REST API Now Includes Metadata

    • Added generation metadata (e.g., generation speed, token count) in the API response.
    • This enables proper integration with WebUI clients that rely on these fields.

  2. Prompt File Input for flm run

    • You can now pass a prompt text file directly: 
      flm run llama3.2 prompt.txt

  3. Code Refactoring for Future Models

    • Internal code structure has been reorganized to support upcoming models more cleanly and modularly.

  4. Improved Model Download (Pull) Interface

    • The model pulling mechanism is more robust and user-friendly for downloading models on demand.

✅ Usage Recap

Interactive CLI:

flm run llama3.2
flm run llama3.2 prompt.txt

Server Mode:

flm serve

Includes /v1/api/completions with metadata support.

Assets 3
Loading