Skip to content

0.9.2 Release

Choose a tag to compare

View all tags
@SerialKicked SerialKicked released this 20 Mar 21:37
· 118 commits to master since this release
0.9.2
a40abdd

Fixed 0.9.x issues, standardized code.

General Improvements

  • llama.cpp backend token estimation is now 100% accurate on normal chat, and 95% accurate on a mix of tool + image + chat.
  • Standardized the code for message generation, and prompt building, massively simplifying the code.
  • Added a Disconnect() function to reset the library's state to a pre-connect state.
  • Updated IPromptBuilder with SingleMessage overloads and improved documentation.
  • Refactor TextPromptBuilder and InstructFormat to use SingleMessage for formatting and token counting.
  • Marked some functions as internal to simplify the life of the user
  • Replaced unclear LLMEngine.UseToolCallsInPrompt with ToolCallsLoaded property
  • Refactored persona loading into a unified LoadPersonas method and added new persona management APIs (HasPersona, GetPersona).
  • Updated system prompt template for clarity and added SelfEditTitle for customizable section headers.
  • Optimized BanList IsAllowed method for readability and efficiency.
  • Better comments / documentation
  • Removed obsolete and duplicate code for better maintainability.

Issues Fixed

  • Fixed prefill detection and settings for Chat Completion backends
  • Fixed issue with first "think" token emission (or lackthereof).
  • Fixed discrepancies between reroll and generate.
  • Image limits settings wouldn't work as expected and would waste tokens

Full Changelog: 0.9.1...0.9.2

Assets 2
Loading