Skip to content

Runora v2.1.4 - Smart GGUF Chat Routing & Engine Fixes

Latest
Latest

Choose a tag to compare

View all tags
@BIJJUDAMA BIJJUDAMA released this 24 Aug 17:08
v2.1.4
a332f92

Runora v2.1.4 - Smart GGUF Chat Routing & Engine Fixes

Added:

  • Running GGUF Auto-Detection: Chat Playground connects automatically to active running GGUF model servers.
  • No Server Guidance Card: Clear prompt directing users to the Launch tab ([2] or [Enter]) when no GGUF server is running.
  • Multi-Instance Model Selector: Interactive card to pick which active GGUF instance to chat with when multiple servers are running.
  • Modifier-Based Hotkeys: Switched chat hotkeys to dedicated modifier shortcuts ([Ctrl+S] Model Switcher, [Ctrl+K] Compact, [Ctrl+P] Parameters, [Ctrl+Y] Copy) eliminating typing interference.
  • Slash Commands: Type commands directly in chat: /compact, /params, /model, /clear, /help.

Fixed:

  • Flash Attention Argument: Fixed server launch failure caused by bare --flash-attn flag by providing explicit --flash-attn on expected by modern llama-server builds.
  • Streamlined Model Inspector: Removed redundant manual task cycling ([E] Task). Models execute under their intrinsic engines based on format (.gguf with llama.cpp, .onnx with ONNX Runtime).
Assets 8
Loading